Quantcast
Channel: Analytics India Magazine
Viewing all articles
Browse latest Browse all 4163

ServiceNow Researchers Release Foundational Model to Generate SVG from Text and Video

$
0
0

On Thursday, a group of researchers from ServiceNow released a new foundational model, StarVector, that helps generate Scalable Vector Graphics (SVG) from text and image inputs.

Juan A. Rodriguez, an AI researcher at ServiceNow Research, announced on X about the model release and its code.

StarVector is a multimodal large language model (MLLM) designed for Scalable Vector Graphics (SVG) generation from images or text instructions. It addresses the limitations of previous SVG generation methods that often produced artifacts and struggled with SVG primitives beyond path curves. 

The research paper stated that StarVector works directly in the SVG code space, leveraging visual understanding to apply accurate SVG primitives for compact, precise outputs. 

To train StarVector, the researchers created SVG-Stack, a large-scale dataset of 2 million samples. They also introduce SVG-Bench, a benchmark across ten datasets and three tasks: Image-to-SVG, Text-to-SVG generation, and diagram generation.

StarVector’s architecture integrates an image encoder to project images into visual tokens and a transformer language model to learn the relationships between instructions, visual features, and SVG code sequences. This enables StarVector to perform image vectorisation and text-driven SVG generation, producing more compact and semantically rich SVGs.

StarVector demonstrates strong performance compared to existing models in image-to-SVG and text-to-SVG tasks. As per the benchmark results, the model outperformed models like GPT-4 Vision (2023), and Potrace.

Rodriguez mentioned that even with the advancements in the model, it hallucinates, sometimes producing inaccurate details. He added that they are actively working on improving and tackling such challenges.

The model is available on Hugging Face, and its code is open-sourced on GitHub under Apache 2.0 licence.


Viewing all articles
Browse latest Browse all 4163

Trending Articles