1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
const axios = require('axios');
const fs = require('fs');
const path = require('path');
async function toB64(imgPath) {
const data = fs.readFileSync(path.resolve(imgPath));
return Buffer.from(data).toString('base64');
}
const api_key = "YOUR API-KEY";
const url = "https://api.segmind.com/v1/automatic-mask-generator";
const data = {
"prompt": "Sofa",
"image": "toB64('https://segmind-sd-models.s3.amazonaws.com/display_images/automask-ip.jpg')",
"threshold": 0.2,
"invert_mask": false,
"return_mask": true,
"grow_mask": 10,
"seed": 468685,
"base64": false
};
(async function() {
try {
const response = await axios.post(url, data, { headers: { 'x-api-key': api_key } });
console.log(response.data);
} catch (error) {
console.error('Error:', error.response.data);
}
})();Attributes
Prompt to render
Upload your input image
Detection threshold
min : 0,
max : 1
Refers to inverting the mask.
Check this to obtain the mask as the output.
Selectively expand image regions
min : 0,
max : 100
Seed for image generation.
min : -1,
max : 999999999999999
Base64 encoding of the output image.
To keep track of your credit usage, you can inspect the response headers of each API call. The x-remaining-credits property will indicate the number of remaining credits in your account. Ensure you monitor this value to avoid any disruptions in your API usage.
Automatic Mask Generator
Automatic Mask Generator is a powerful tool that automates the creation of precise masks for inpainting. This innovative solution streamlines your workflow by combining the strengths of two cutting-edge AI models: Grounding DINO and Segment Anything Model (SAM).
Targeted Object Detection with Grounding DINO: The process starts with Grounding DINO, acting as a highly accurate object detector. Imagine feeding an image along with a specific object category (e.g., "cat" or "building") to Grounding DINO. It meticulously analyzes the image and pinpoints the location of the desired object with exceptional precision.
Seamless Segmentation with SAM: Once Grounding DINO identifies the object of interest, SAM takes center stage. SAM, a segmentation powerhouse, meticulously analyzes the image, focusing specifically on the object identified by Grounding DINO. This targeted segmentation separates the object from the rest of the image, creating a clear distinction.
Mask Generation for Precise Inpainting: With the object neatly segmented, Automatic Mask Generator creates a high-quality mask. This mask acts as a blueprint for Stable Diffusion inpainting. Black pixels within the mask represent areas to be preserved (the object itself), while white pixels indicate areas to be filled by the inpainting process. This precise definition ensures Stable Diffusion focuses on the desired inpainting area, leading to more accurate and realistic results.
Benefits of Automatic Mask Generation
-
Enhanced Efficiency: Automating mask creation eliminates time-consuming manual processes, allowing you to focus on creative aspects of inpainting.
-
Improved Accuracy: The combined power of Grounding DINO and SAM ensures precise object detection and segmentation, leading to more accurate masks and superior inpainting outcomes.
-
Simplified Workflow: Automatic Mask Generator streamlines your workflow by handling mask creation, enabling you to seamlessly transition to the inpainting stage.
-
Greater Control: Precise masks provide greater control over the inpainting process, allowing you to refine the results to your specific vision.
Popular Models
