Embeddings Are Not Magic
    Back to Articles
    Algorithm Science and Technical SEO

    Embeddings Are Not Magic

    Michael
    January 6, 2025

    Every page on your website exists as a point in mathematical space. Google doesn't read your content the way a human does. It converts words, sentences, and entire documents into dense numerical vectors, then measures the geometric distance between those vectors and the queries people type. That process is called embedding, and understanding how Google embeddings SEO actually works separates people optimizing for a search engine that existed ten years ago from those optimizing for the one ranking sites right now.

    The SEO industry talks about embeddings like they're either incomprehensible academic theory or a magic wand that explains everything. Neither is true. Google embeddings SEO is grounded in specific, well-documented mathematical techniques Google has been refining since at least 2013. The leaked API documentation from 2024 confirmed embeddings are woven into the ranking infrastructure. If you understand what embeddings do, how Google generates them, and what they mean for your content strategy, you gain a structural advantage over competitors still optimizing for keyword density and exact-match anchor text.

    What an Embedding Actually Is

    An embedding is a numerical representation of meaning. When Google processes text, it doesn't store the words themselves in its ranking systems. It passes them through a neural network that outputs a vector, a list of numbers, typically between 128 and 768 dimensions. Each dimension captures some aspect of the text's meaning, though no single dimension maps neatly to a human concept like "topic" or "sentiment." Meaning emerges from the relationships between all the dimensions simultaneously.

    Consider the word "bank." In isolation, it could mean a financial institution or the side of a river. A keyword-matching system can't distinguish between them. An embedding model processes "bank" in the context of the surrounding sentence and produces a vector that points in the direction of the correct meaning. "I deposited money at the bank" produces a vector geometrically close to vectors for "savings account" and "interest rate." "We fished from the bank of the river" produces a vector close to "shoreline" and "current." Same word, completely different vectors, because the model encodes meaning rather than matching strings.

    This is not hypothetical. Google's patent US20200004886A1, titled "Generating supervised embedding representations for search," describes a dual-encoder architecture where queries and documents are independently projected into a shared embedding space. The system then uses cosine similarity, the angular distance between two vectors, to determine how closely a document's meaning aligns with what a searcher actually wants. The closer the vectors, the stronger the semantic match.

    RankEmbed and the Speed of Understanding

    Google doesn't use a single embedding system. The ranking pipeline involves multiple models operating at different stages, each optimized for a different tradeoff between speed and depth. RankEmbed is the system most relevant to how your pages initially get scored.

    RankEmbed is a dual-encoder model that independently embeds queries and documents into a shared vector space. The critical word is "independently." Because the query and document are encoded separately, the system can pre-compute document embeddings and store them. When a new query arrives, Google only needs to encode the query and then perform a nearest-neighbor lookup against billions of pre-computed document vectors. Google described RankEmbed internally as "extremely fast." It doesn't need to re-read every document for every query. It compares vectors.

    Speed matters because RankEmbed operates in the retrieval stage of the ranking pipeline, the stage that narrows billions of indexed pages down to a manageable set of candidates. If your page's embedding isn't close enough to the query embedding at this stage, it never reaches the more sophisticated ranking systems downstream. Your content could be the best answer on the internet, but if its embedding doesn't land in the right neighborhood of the vector space, it's invisible.

    RankEmbed is trained on approximately one month of search interaction data. This means the model's understanding of what documents satisfy what queries is continuously updated based on real user behavior. The connection to NavBoost's click signals isn't coincidental. The engagement data that NavBoost collects feeds into the training signal that teaches RankEmbed which query-document pairs represent genuine satisfaction. The embedding model learns from how humans actually interact with search results, not from abstract linguistic rules.

    DeepRank and the Final Judgment

    After RankEmbed narrows the candidate set, a more computationally expensive system called DeepRank takes over. Where RankEmbed encodes queries and documents independently for speed, DeepRank uses cross-attention mechanisms that process the query and document together, allowing it to capture fine-grained interactions between specific query terms and specific document passages.

    Google's internal documentation describes DeepRank as a system that "understands the meaning of documents." Mike King of iPullRank, who published one of the most thorough analyses of the leaked API documentation, noted that DeepRank's cross-attention architecture represents a different approach to relevance evaluation than anything in Google's pre-neural systems. That matters. RankEmbed understands meaning well enough to retrieve relevant candidates quickly. DeepRank understands meaning well enough to rank those candidates in the order that best satisfies the searcher. The distinction is between approximate semantic matching and precise semantic evaluation.

    DeepRank operates on the top twenty to thirty candidates that survive the retrieval stage. This is where the quality of your content's semantic depth becomes decisive. A page that covers a topic superficially might generate an embedding close enough to the query to pass RankEmbed's filter. But when DeepRank cross-attends between the query and the document, it can identify whether the page actually addresses the specific nuance the searcher needs. Shallow content gets retrieved but doesn't get ranked.

    This two-stage architecture explains a phenomenon that confuses many site owners. They see their page appearing in positions fifteen through thirty for a competitive query, never breaking into the top ten despite months of optimization. The page passes retrieval. Its embedding is in the right neighborhood. But it fails the deeper semantic evaluation because its content doesn't match the query's intent at the level of granularity DeepRank requires. The solution isn't more backlinks or better meta tags. It's deeper, more precise content that addresses exactly what the query is asking.

    What the API Leak Revealed About Site-Level Embeddings

    The May 2024 API documentation leak was significant for many reasons, but its embedding-related revelations were among the most consequential for SEO. The leaked attributes confirmed that Google doesn't just generate embeddings at the page level. It generates them at the site level.

    Three attributes stood out. First, site2vecEmbedding, a vector representation of the entire site's topical identity. This isn't an average of all page embeddings. It's a learned representation that captures what the site as a whole is about. Second, siteFocusScore, a measure of how tightly the site's content clusters around its core topics. Third, siteRadius, which measures how far the site's content spreads from its topical center in the embedding space.

    These three attributes together describe a model of topical authority that operates entirely in vector space. A site with a tight siteFocusScore and small siteRadius is one where every page reinforces the same core topics. A site with a loose focus score and large radius is one that covers many unrelated topics without depth in any of them. Google isn't just asking whether your individual page matches a query. It's asking whether your entire site has the topical coherence to be an authority on the subject that page covers.

    This is why your site architecture is a confession. Every page you publish shifts your site's embedding. A manufacturing company that publishes blog posts about unrelated trending topics isn't building topical authority. It's expanding its siteRadius, diluting its siteFocusScore, and telling Google's embedding systems that it doesn't have a coherent identity. The pages might individually contain reasonable content, but the site-level signal undermines them all.

    ScaNN and the Infrastructure of Similarity

    Understanding embeddings also requires understanding how Google searches through them at scale. The system used for approximate nearest-neighbor lookup is called ScaNN, which stands for Scalable Nearest Neighbors. Google open-sourced ScaNN in 2020, and the published benchmarks showed it outperforming previous nearest-neighbor algorithms by roughly 20% in retrieval accuracy at the same computational cost.

    ScaNN works by partitioning the embedding space into regions and using a technique called anisotropic vector quantization to compress embeddings while preserving the directional information that cosine similarity depends on. In practical terms, this means Google can compare a query embedding against billions of document embeddings in milliseconds. The infrastructure isn't a bottleneck. Google can afford to use embeddings at every stage of the ranking pipeline because ScaNN makes the comparison cheap enough to run at search-time scale.

    For anyone serious about Google embeddings SEO, the implication is that embedding-based retrieval isn't an experimental feature or a future direction. It's the production system running right now on every query. When you type something into Google, the first filtering step that determines whether your page is even a candidate for ranking is an embedding similarity calculation executed through ScaNN. This has been true for years, and the infrastructure is only getting faster and more precise.

    How Embeddings Changed What "Relevance" Means

    Before embeddings, relevance was primarily a function of term matching. Google's earlier systems, including the original PageRank-era algorithm, determined relevance by checking whether the words in a query appeared in a document, weighted by factors like position, frequency, and formatting. This is why keyword density was once a viable optimization strategy. If the system counted words, putting more of the right words on the page genuinely helped.

    Embeddings redefined relevance as semantic similarity rather than lexical overlap. A page about "how to fix a leaking faucet" can now rank for the query "dripping tap repair" even if those exact words never appear on the page, because the embedding vectors for those two phrases point in nearly the same direction. Conversely, a page stuffed with the exact query terms but lacking genuine topical coverage will produce an embedding that drifts away from the query's vector, because the model recognizes that keyword repetition without semantic depth isn't the same as meaning.

    This shift has been gradual. BERT's integration in 2019 brought transformer-based embeddings to query understanding. The Multitask Unified Model, MUM, extended that capability across languages and modalities. Each generation of embedding model has increased Google's ability to match queries with documents based on what they mean rather than what they literally say. The December 2024 core update, which likely integrated Gemini 2.0 capabilities into the ranking pipeline, almost certainly improved the embedding models that RankEmbed and DeepRank use, making semantic matching even more precise.

    I see this in the audits I run through our technical SEO engagements. Clients who built their content around exact-match keyword targeting five years ago are watching those pages slowly lose ground to competitors who cover the same topics with more semantic breadth. The pages with narrow keyword focus produce embeddings that match a narrow slice of query space. The pages with comprehensive topical coverage produce embeddings that match a wider, more relevant neighborhood of queries. Over time, the comprehensive pages accumulate more positive engagement data, which feeds back into RankEmbed's training signal, which further reinforces their advantage. The gap compounds.

    Practical Implications for Content Strategy

    If the Google embeddings SEO model is correct, and the evidence overwhelmingly says it is, then your content strategy is fundamentally a strategy about where your pages land in embedding space. Every editorial decision you make, what topics to cover, what subtopics to include, what language to use, what depth to reach, shifts where your page's vector points.

    The first practical implication is that topical completeness matters more than keyword frequency. A page about embeddings that covers the history from Word2Vec through BERT to modern dual-encoder architectures will produce a richer, more dimensionally complete vector than a page that mentions "embeddings" fifty times without exploring the concept. The embedding model rewards depth because depth activates more dimensions of the vector, creating a representation that matches what users searching for that topic actually want to learn.

    The second implication is that site-level topical coherence directly affects page-level rankings. Because site2vecEmbedding and siteFocusScore influence how Google evaluates individual pages, every piece of content you publish either reinforces or weakens your site's topical authority in the embedding space. This is the mathematical basis for the content silo strategy. Pages within a silo cluster tightly in embedding space, reinforcing the site's authority signal for that topic cluster. Pages outside any silo push the site's embedding outward, increasing siteRadius and reducing siteFocusScore.

    The third implication is that understanding how Google actually ranks websites now requires understanding that traditional ranking signals like backlinks and on-page optimization are being evaluated in the context of embedding-based relevance. A backlink from a topically related site strengthens your page's position in the embedding space more than a backlink from an unrelated domain, because Google can measure the semantic distance between the linking page's embedding and your page's embedding. Topical relevance is no longer a subjective editorial judgment. It's a geometric calculation.

    The Uncomfortable Precision of Vector Space

    Embeddings are not magic. They're math. Specifically, they're the output of neural networks trained on massive datasets of human search behavior, designed to project the messy complexity of language into a structured numerical space where similarity can be measured with a single calculation.

    What makes embeddings uncomfortable for SEO is their precision. A keyword-matching system could be gamed with enough repetition and the right anchor text. An embedding-based system evaluates meaning, and meaning is harder to fake. You can't trick a cosine similarity calculation into believing your page covers a topic comprehensively when it doesn't. The vector either points in the right direction or it doesn't, and no amount of on-page optimization can rotate a vector that the content itself doesn't support.

    The reality of Google embeddings SEO is that the sites that will thrive in an embedding-driven ranking environment are the ones that build genuine depth, genuine coherence, and genuine authority within focused topic areas. The sites that will struggle are the ones that spread thin across many topics, optimize for keywords rather than meaning, and rely on signals that exist outside the embedding space to compensate for content that doesn't earn its position within it.

    Google's ranking systems have moved from counting words to understanding meaning. Your content strategy needs to make the same transition, or you'll keep optimizing for a search engine that no longer exists.

    MM

    Michael McDougald

    Founder of Right Thing SEO, a math-driven SEO agency based in Nashville and Sarasota. Michael has spent 15+ years helping businesses achieve sustainable organic growth through data-driven strategies.

    Learn more about Michael →

    Ready to Stop the Fall?

    Get a free SEO assessment and discover what's holding your site back.