Welcome.AI
    Skip to content
    Article

    Meta Andromeda Achieves 100x Faster Ad Retrieval and Increased Conversions

    Meta Andromeda is revolutionizing ad retrieval with unprecedented efficiency, processing over one billion ads per second. This leap forward not only enhances performance but also provides advertisers with greater opportunities for improved conversion rates.

    engineering.fb.com•October 28, 2026•3 min read

    Key Facts

    • Meta Andromeda scores ads at 1 billion/sec, a 100x increase, enhancing ad relevance and efficiency.
    • 2.4% rise in conversions since 2025 indicates strong ROI for advertisers using Meta's ad system.
    • Co-designing model and hardware reduces costs while improving performance, enhancing competitive edge.
    • Index matching throughput exceeds 100 billion ads/sec, revealing significant scalability potential ahead.
    • Fused GPU pipeline eliminates bottlenecks, ensuring sustained growth without proportional infrastructure costs.

    Summary

    Meta Platforms has unveiled the latest iteration of its personalized ads retrieval engine, Meta Andromeda, which significantly enhances the efficiency and effectiveness of ad retrieval through a co-designed approach that integrates model, system, and GPU hardware. This development is crucial as it sets a new benchmark in ad retrieval performance, processing over one billion ads per second—representing a 100-fold increase compared to the previous system launched in 2024. The implications for advertisers are substantial, as this advancement allows for better ad matching across a larger pool of candidates, potentially increasing conversion rates and maximizing advertising ROI.

    The Meta Andromeda system, which began its evolution in 2024, has undergone significant upgrades to its architecture and operational capabilities. Historically, the deep modeling quality required for effective ad ranking was too resource-intensive to apply at the scale necessary for retrieval. The 2024 version leveraged NVIDIA's GH200 Grace Hopper Superchip, allowing for a four-order magnitude increase in model capacity. The latest updates build on this foundation, utilizing a mixture-of-experts (MoE) architecture that allows for near-ranking-level performance while drastically reducing the computational load—achieving approximately 300 times fewer inference-time floating-point operations compared to its predecessor.

    As Meta continues to expand its ad candidate pool, driven by generative AI tools that enable rapid ad creation, the need for efficient retrieval systems becomes increasingly critical. The 2026 Meta Andromeda introduces a fused GPU pipeline that integrates model execution and system logic, eliminating traditional bottlenecks associated with memory bandwidth. This architectural shift allows for real-time processing of user-ad interactions, enhancing throughput while reducing latency. The co-location of index matching and scoring on the same GPU further streamlines operations, cutting network traffic by approximately 100 times and shifting the system back to a compute-bound regime.

    The collaboration between Meta and NVIDIA has been pivotal in pushing the boundaries of what is achievable in ad retrieval. By optimizing each component of the retrieval pipeline, they have achieved significant speed improvements, with index matching now capable of processing over 100 billion ads per second. This advancement not only enhances the system's efficiency but also confirms that there remains substantial headroom for future model growth without proportional increases in infrastructure costs.

    For advertisers, these enhancements translate into better-targeted ads that are more relevant to users, ultimately driving higher conversion rates. Meta has reported a 2.4% increase in conversions on Facebook since the introduction of Andromeda, reflecting the tangible benefits of these technological advancements. As the volume of eligible ads continues to grow, Meta's ability to maintain high levels of performance while managing costs positions it favorably against competitors in the digital advertising landscape.

    Looking ahead, the principles of co-design that have driven these advancements will likely extend to future model architectures and hardware platforms. As Meta continues to refine its approach, the integration of deeper interaction networks and richer feature spaces will enable even greater model complexity and performance. This strategic focus not only enhances the value proposition for advertisers but also solidifies Meta's competitive edge in an increasingly crowded market. The ongoing evolution of Meta Andromeda signals a commitment to leveraging advanced technology to optimize advertising outcomes, ensuring that Meta remains at the forefront of digital marketing innovation.

    Entities Mentioned

    Companies

    Meta
    NVIDIA

    Products

    Meta Andromeda

    Technologies

    GPU
    machine learning
    generative AI
    deep neural networks
    Mixture-of-Experts (MoE)

    People

    Gosh Arzumanyan
    Habiya Beg
    Andrew Bocking
    Zain Brohi
    Rohit Chandel
    Claire Chen
    Jason Chen
    Wenlin Chen
    Zhenyu Chen
    Yuze Dai

    Key Concepts

    ads retrieval
    model-system co-design
    throughput optimization
    NVIDIA collaboration
    Mixture-of-Experts architecture
    advertiser value
    scalability
    real-time processing

    Definitions

    ads retrieval
    The process of narrowing down a vast pool of eligible ads to a small set of strong candidates for display to users.
    Mixture-of-Experts (MoE)
    An architecture that uses multiple specialized models (experts) to improve performance and efficiency in machine learning tasks.
    throughput
    The amount of data processed by a system in a given amount of time, often measured in ads per second in this context.
    co-design
    The collaborative design of models, systems, and hardware to optimize performance and efficiency.
    generative AI
    AI technologies that can create new content, such as ads, based on learned patterns from existing data.

    Use Cases

    • →increased ad conversions
    • →real-time ad matching
    • →scalable ad retrieval for large candidate pools
    • →efficient use of GPU resources
    • →enhanced user experience through relevant ads
    • →advertiser targeting optimization

    Frequently Asked Questions

    What is Meta Andromeda?

    Meta Andromeda is a personalized ads retrieval engine designed to efficiently match ads to users by narrowing down a large pool of candidates. It utilizes advanced machine learning techniques to enhance ad performance.

    How does co-design improve ad retrieval?

    Co-design integrates the model, system, and hardware to optimize performance and efficiency, allowing for faster ad retrieval and better matching. This results in improved advertiser value and user experience.

    What role does NVIDIA play in Meta Andromeda?

    NVIDIA collaborates with Meta to optimize the GPU hardware and software components of the Andromeda system, enhancing throughput and overall performance of ad retrieval operations.

    What are the benefits of using Mixture-of-Experts architecture?

    The Mixture-of-Experts architecture allows for more expressive models that can deliver near-ranking-level performance while significantly reducing computational costs. This makes ad retrieval more efficient.

    How does Meta Andromeda handle large ad candidate pools?

    Meta Andromeda employs advanced algorithms and optimizations to efficiently process and score billions of ads per second, ensuring that users receive relevant ads quickly and effectively.

    Where AI Leaders Stay Informed

    The latest AI intelligence, case studies, and research — delivered to your inbox every week.

    Free to read. Unsubscribe anytime.