1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
const axios = require('axios');
const FormData = require('form-data');
const api_key = "YOUR API-KEY";
const url = "https://api.segmind.com/v1/runway-gen4-aleph";
const reqBody = {
"seed": 42,
"video": "https://segmind-resources.s3.amazonaws.com/input/c08771b9-b671-4c12-9ea7-af4048b9d194-894a8bdf-6064-40ea-a78d-06c1abff262b.mp4",
"prompt": "make it winter",
"aspect_ratio": "9:16"
};
(async function() {
try {
const formData = new FormData();
// Append regular fields
for (const key in reqBody) {
if (reqBody.hasOwnProperty(key)) {
formData.append(key, reqBody[key]);
}
}
// Convert and append images as Base64 if necessary
const response = await axios.post(url, formData, {
headers: {
'x-api-key': api_key,
...formData.getHeaders()
}
});
console.log(response.data);
} catch (error) {
console.error('Error:', error.response ? error.response.data : error.message);
}
})();Attributes
Random seed for reproducibility. Set specific numbers for consistent results across runs.
Input video for transformation, max 16MB. Use high-quality clips for best results.
Text prompt to guide video transformation. Try 'in summer' for seasonal changes.
Choose desired video aspect ratio. Use '21:9' for cinematic effects.
Allowed values:
Image to influence video style. Select vibrant images for colorful outputs.
To keep track of your credit usage, you can inspect the response headers of each API call. The x-remaining-credits property will indicate the number of remaining credits in your account. Ensure you monitor this value to avoid any disruptions in your API usage.
Runway Aleph – AI Video Editing Model
What is Runway Aleph?
Runway Aleph is an advanced AI video model that transforms video editing through intelligent automation. This multi-task visual manipulation model enables creators to add, remove, or transform objects in videos using simple text prompts or reference images. Unlike traditional video editing tools that require manual frame-by-frame work, Aleph understands context and applies complex transformations across entire video sequences while maintaining temporal consistency and visual quality.
Key Features
• Object manipulation – Add, remove, or replace objects seamlessly across video frames
• Environment transformation – Change lighting conditions, weather, seasons, and backgrounds
• Style transfer – Apply artistic styles and visual aesthetics using reference images
• Camera angle generation – Create new perspectives and shots from existing footage
• Green screen isolation – Automatic background removal and replacement
• Motion preservation – Maintains natural movement and physics during transformations
• Multi-format support – Works with various aspect ratios from square to cinematic 21:9
Best Use Cases
Content creators can quickly transform seasonal footage, change video aesthetics, or remove unwanted elements without expensive reshoots. Filmmakers benefit from rapid prototyping of visual effects, environment changes, and style experimentation during pre-production.
Marketing teams can adapt existing video assets for different campaigns, seasons, or brand guidelines. Social media managers can repurpose content across platforms by changing aspect ratios and visual styles to match platform aesthetics.
Educational content producers can create multiple versions of instructional videos with different visual contexts or environments.
Prompt Tips and Output Quality
Write specific, descriptive prompts for best results. Instead of "change background," use "replace with sunny beach scene with palm trees." Reference seasonal changes work particularly well – try "make it winter with snow" or "transform to autumn with orange leaves."
Use the reference image parameter to guide style and color palette. High-contrast, vibrant reference images typically produce more dramatic transformations.
Set consistent seed values when iterating on the same concept to maintain visual coherence across multiple generations.
FAQs
How large can my input video be?
Maximum file size is 16MB. Use high-quality clips for optimal results, but compress larger files before uploading.
What aspect ratios does Aleph support?
Choose from 16:9, 9:16, 4:3, 3:4, 1:1, and cinematic 21:9 ratios to match your platform requirements.
Can I use reference images with text prompts?
Yes, combine both for enhanced control. The reference image influences style while the text prompt guides specific transformations.
How do I get consistent results?
Use the seed parameter with specific numbers. The same seed with identical inputs produces reproducible outputs.
Is Runway Aleph better than other video AI models?
Aleph excels at multi-task video manipulation and temporal consistency, making it ideal for complex transformations other models struggle with.
What video formats work best?
MP4 format with good lighting and stable footage produces optimal results for AI processing.
Popular Models
