Support the Ukrainian fight for freedom

RUSSIAN WARSHIP, GO F*CK YOURSELF

I've been building e-commerce search applications for almost ten years. Below you can find a list of (some) publications, conferences and books that inspire me. Grouped by topic (If an article fits into multiple topics - it goes into multiple sections).

⭐ Star us on GitHub — it helps!

Also check my other collections awesome e-commerce, awesome knowledge graphs, awesome cloud apps

• General, fun, philosophy
• Types of search
  • Classic/Lexical search
  • Vectors/Semantic search
    • Embeddings
      • Types of vectors
        • Dense vectors
          • Matryoshka embeddings
        • Sparse vectors
          • SPLADE
      • Encoder models
        • Main architectures
        • Query/Document tokens interaction
          • No interactions - Two towers / Bi-encoders
          • Early interactions - Cross-encoders
          • Late interactions - ColBERT
      • Handling high-dimension embeddings
        • Dimensionality reduction
        • Quantization
          • Scalar quantization
          • Binary quantization
    • Symmetric and Asymmetric semantic search
  • Hybrid search
    • Reciprocal rank fusion - RRF
  • Multimodal search
• Areas of application
  • Enterprise search
  • e-Commerce search
  • Conversational search
  • Geo-Spatial Search
  • Medical and Healthcare Search
  • Social Media and User-Generated Content Search
  • Question Answering Systems
  • Personal Information Management
• Search Results
  • Retrieval
    • Relevance
      • Relevance Algorithms
  • Ranking
    • Multi stage ranking
    • Learning to Rank
      • Click models for search
  • Bias
  • Diversification
  • Personalisation
  • Zero search results
• Search UX
  • Baymard Institute
  • Nielsen Norman Group
  • Enterprise Knowledge LLC
  • Facets
    • Accidental Taxonomist
  • Other
• Spelling correction
• Suggestions
• Synonyms
• Stopwords
• Graphs/Taxonomies/Knowledge Graph
  • Integrating Search and Knowledge Graphs (by Enterprise Knowledge)
• Query expansion
• Query understanding
  • Search Intent
  • Query segmentation
• Algorithms
  • BERT
  • ColBERT
  • Collocations, common phrases
  • Other Algorithms
• Tracking, profiling, GDPR, Analysis
• Experiments
  • A/B testing, MABs
• Evaluating search
  • MRR
  • Testing, metrics, KPIs
    • Metrics
    • KPIs
  • Evaluating Search (by Daniel Tunkelang)
  • Measuring Search (by James Rubinstein)
  • Three Pillars of Search Relevancy (by Andreas Wagner)
• Architecture
• Vectors search
• Education and networking
  • Conferences
  • Trainings and courses
  • Books
  • Blogs and Portals, News
  • Papers
• Management, Search Team
  • Job Interviews
  • Engineering
• Industry players
  • Personalies and influencers
  • Search Engines
  • Products and services
  • Consulting companies
• Blogposts series
  • Search Optimization 101 (by Charlie Hull)
  • Query Understanding (by Daniel Tunkelang)
  • Grid Dynamics
  • Considering Search: Search Topics (by Derek Sisson)
• Videos
  • Channels
  • Featured
• Case studies
  • General search
  • Multisided markets
  • E-commerce
• Datasets
• Tools

• sandbox Jun 2021
• sandbox May 2021
• sandbox April 2021
• sandbox Dec 2020
• sandbox Jan 2020

• Falsehoods Programmers Believe About Search
• Ethical Search: Designing an irresistible journey with a positive impact
• On Semantic Search
• Feedback debt: what the segway teaches search teams
• Supporting the Searcher’s Journey: When and How
• Shopping is Hard, Let’s go Searching!
• An Introduction to Search Quality
• On-Site Search Design Patterns for E-Commerce: Schema Structure, Data Driven Ranking & More
• In Search of Recall
• Balance Your Search Budget!

• Evolution of Search Technology: A Look Ahead

• Etsy. Targeting Broad Queries in Search
• How Etsy Uses Thermodynamics to Help You Search for “Geeky”
• Broad and Ambiguous Search Queries
• Deconstructing E-Commerce Search: The 12 Query Types

• Migrating to Elasticsearch with dense vector for Carousell Spotlight search engine

• From zero to semantic search embedding model

• Guidelines to choose an index

• Pinecone Series

  • Nearest Neighbor Indexes for Similarity Search
  • The Missing WHERE Clause in Vector Search

  Symmetric and Asymmetric semantic search

  • Symmetric vs. Asymmetric Semantic Search

• Bi-encoder vs Cross encoder?When to use which one?
• What is ColBERT and Late Interaction and Why They Matter in Search?

• Choosing the best model for semantic search

• Announcing the Vespa ColBERT embedder
• What is ColBERT and Late Interaction and Why They Matter in Search?

• Matryoshka embeddings: faster OpenAI vector search using Adaptive Retrieval
• Introduction to Matryoshka Embedding Models
• Matryoshka representations. A guide to faster semantic search

• Hybrid Search: SPLADE (Sparse Encoder)
• SPLADE for Sparse Vector Search Explained

• Hybrid search > sum of its parts?
• On Hybrid Search
• Hybrid search with Re-ranking

• Hybrid search with Re-ranking
• Reciprocal rank fusion

• Muves: Multimodal & multilingual vector search w/ Hardware Acceleration
• Model Selection for Multimodal Search

• GenAI Can Improve Enterprise Search, But Remains a Work In Progress

• The influence of TF-IDF algorithms in eCommerce search

• Search as a Conversation
• Affordances for Conversational Search
• Query Understanding and Chatbots

• Humans Search for Things not for Strings
• What is a ‘Relevant’ Search Result?
• How to Achieve Ecommerce Search Relevance
• Setting up a relevance evaluation program

• Practical BM25: How Shards Affect Relevance Scoring in Elasticsearch, The BM25 Algorithm and its Variables
• The influence of TF-IDF algorithms in eCommerce search
• BM25 The Next Generation of Lucene Relevance
• Lucene Similarities (BM25, DFR, DFI, IB, LM) Explained

• Multi stage ranking

• How is search different than other machine learning problems?
• Reinforcement learning assisted search ranking
• E-commerce Search Re-Ranking as a Reinforcement Learning Problem
• When to use a machine learned vs. score-based search ranker
• What is Learning To Rank?
• Using AI and Machine Learning to Overcome Position Bias within Adobe Stock Search
• Train and Test Sets Split for Evaluating Learning To Rank Models
• How LambdaMART works - optimizing product ranking goals

• Click models
• Click Modeling for eCommerce
• Using Behavioral Data to Improve Search

• What is Presentation Bias in search?
• Dealing with Position Bias in Recommendations and Search

• Search Result Diversification using Causal Language Models
• Learning to Diversify for E-commerce Search with Multi-Armed Bandit
• Search Quality for Discovery & Inspiration
• How to measure Diversity of Search Results
• Searching for Goldilocks
• Broad and Ambiguous Search Queries - Recognizing When Search Results Need Diversification
• Thoughts on Search Result Diversity

• Patterns for Personalization in Recommendations and Search
• Daniel Tunkelang Personalization
• Airbnb - Real-time personalization in search
• 98 personal data points that facebook uses to target ads to you
• Architecture of real world recommendation systems
• Feature engineering for personalized search

• Strategies for using alternative queries to mitigate zero results and their application to online marketplaces
• Semantic Equivalence of e-Commerce Queries

• Deconstructing E-Commerce Search: The 12 Query Types
• Autodirect or Guide Users to Matching Category
• 13 Design Patterns for Autocomplete Suggestions (27% Get it Wrong)
• E-Commerce Search Needs to Support Users’ Non-Product Search Queries (15% Don’t)
• Search UX: 6 Essential Elements for ‘No Results’ Pages
• Product Thumbnails Should Dynamically Update to Match the Variation Searched For (54% Don’t)
• Faceted Sorting - A New Method for Sorting Search Results
• The Current State of E-Commerce Search
• E-Commerce Sites Need Multiple of These 5 ‘Search Scope’ Features
• E-Commerce Search Field Design and Its Implications
• E-Commerce Sites Should Include Contextual Search Snippets (96% Get it Wrong)
• E-Commerce Search Usability: Report & Benchmark
• Six ‘COVID-19’ Related E-Commerce UX Improvements to Make

• The Love-at-First-Sight Gaze Pattern on Search-Results Pages
• Good Abandonment on Search Results Pages
• Complex Search-Results Pages Change Search Behavior: The Pinball Pattern
• Site Search Suggestions
• Search-Log Analysis: The Most Overlooked Opportunity in Web UX Research
• Scoped Search: Dangerous, but Sometimes Useful
• 3 Guidelines for Search Engine "No Results" Pages

• Optimizing Your Search Experience: A Human-Centered Approach to Search Design

• Facets of Faceted Search
• Coffee, Coffee, Coffee!
• Faceted Search (start here!)
• How to implement faceted search the right way
• Metadata and Faceted Search
• Metacrap: Putting the torch to seven straw-men of the meta-utopia
• 7 Filtering Implementations That Make Macy’s Best-in-Class
• Facet Search: The Most Comprehensive Guide. Best Practices, Design Patterns, Hidden Caveats, And Workarounds
• Facets: Constraints or Preferences?
• Facets, But Which Ones?

• How Many Facets Should a Taxonomy Have
• When a Taxonomy Should not be Hierarchical
• Customizing Taxonomy Facets

• Learning from Friction to Improve the Search Experience
• Why is it so hard to sort by price?
• Faceted Sorting
• Google kills Instant Search

• Peter Norvig. "How to Write a Spelling Corrector". Classic publication.
• Daniel Tunkelang. "Spelling Correction"
• A simple spell checker built from word vectors
• A closer look into the spell correction problem: 1, 2, 3, preDict
• Deep Spelling
• Modeling Spelling Correction for Search at Etsy
• Wolf Garbe. Author of Sympell. 1000x Faster Spelling Correction algorithm, Top highlight SymSpell vs. BK-tree: 100x faster fuzzy string search & spell checking, Fast Word Segmentation of Noisy Text
• Chars2vec: character-based language model for handling real world texts with spelling errors and
• JamSpell, spelling correction taking into account surrounding context - library, (in russian) Исправляем опечатки с учётом контекста
• Embedding for spelling correction
• A simple spell checker built from word vectors
• What are some algorithms of spelling correction that are used by search engines?
• Moman - lucene/solr/elasticsearch spell correction/autocorrect is (was?) actually powered by this library.
• Query Segmentation and Spelling Correction
• Applying Context Aware Spell Checking in Spark NLP
• Autocorrect in Google, Amazon and Pinterest and how to write your own one

• Boosting the power of Elasticsearch with synonyms
• Real Talk About Synonyms and Search
• Synonyms in Solr I — The good, the bad and the ugly
• Synonyms and Antonyms from WordNet
• Synonyms and Antonyms in Python
• Dive into WordNet with NLTK
• Creating Better Searches Through Automatic Synonym Detection
• Multiword synonyms in search using Querqy
• How to Build a Smart Synonyms Model
• The importance of Synonyms in eCommerce Search

• Do all-stopword queries matter?

Synonyms: autocomplete, search as you type, suggestions

• Giovanni Fernandez-Kincade. Bootstrapping Autosuggest, Building an Autosuggest Corpus, Part 1, Building an Autosuggest Corpus, Part 2, Autosuggest Retrieval Data Structures & Algorithms, Autosuggest Ranking
• On two types of suggestions
• Improving Search Suggestions for eCommerce
• Autocomplete Search Best Practices to Increase Conversions
• Why we’ve developed the searchhub smartSuggest module and why it might matter to you
• Nielsen Norman Group: Site Search Suggestions
• 13 Design Patterns for Autocomplete Suggestions
• Autocomplete
• Autocomplete and User Experience
• IMPLEMENTING A LINKEDIN LIKE SEARCH AS YOU TYPE WITH ELASTICSEARCH
• Smart autocomplete best practices: improve search relevance and sales
• OLX: Building Corpus for AutoSuggest (Part 1), AutoSuggest Retrieval & Ranking (Part 2)
• Autocomplete, Live Search Suggestions, and Autocorrection: Best Practice Design Patterns
• Mirror, Mirror, What Am I Typing Next? All About Search Suggestions

• Knowledge graphs applied in the retail industry

  Knowledge graphs are becoming increasingly popular in tech. We explore how they can be used in the retail industry to enrich data, widen search results and add value to a retail company.

• Awesome Knowledge Graphs

• Part 1: Displaying Relationships
• Search query expansion with query embeddings

• Fundamentals of query rewriting (part 1): introduction to query expansion

• Daniel Tunkelang Query Understanding.
• Query Understanding, Divided into Three Parts
• Search for Things not for Strings
• Understanding the Search Query. Part 1, Part 2, Part 3
• Food Discovery with Uber Eats: Building a Query Understanding Engine
• AI for Query Understanding

• Mapping Search Queries To Search Intents
• Search: Intent, Not Inventory

• Paper Unsupervised Query Segmentation Using only Query Logs
• Paper Towards Semantic Query Segmentation

• Understanding BERT and Search Relevance
• Google is improving web search with BERT – can we use it for enterprise search too?

• Pretrained Transformer Language Models for Search - part 3

• Automatically detect common phrases – multi-word expressions / word n-grams – from a stream of sentences.
• The Unreasonable Effectiveness of Collocations

• One hot encoding
• Writing a full-text search engine using Bloom filters

• Locality Sensitive Hashing
• Locality Sensitive Hashing (LSH): The Practical and Illustrated Guide
• Minhash

• Better than Average: Sort by Best Rating
• How Not To Sort By Average Rating

• Keyword Extraction using RAKE
• Yet Another Keyword Extractor (Yake)
• Keyword Extraction with BERT

• OpenSearch User Behavior Insights
• Site Search tracking with Google Analytics 4
• Snowplow
• search-colletor
• OpenTelemetry with search additions

• Anonymisation: managing data protection risk (code of practice)
• The Anonymisation Decision-Making Framework
• 98 personal data points that facebook uses to target ads to you
• Opportunity Analysis for Search
• A Face Is Exposed for AOL Searcher No. 4417749
• AOL search data leak
• Personal data

• Common Pitfalls of Search Experimentation
• Improving Search @scale with efficient query experimentation

• A/B Testing for Search is Different
• A/B Testing Search: thinking like a scientist

• Discounted cumulative gain
• Flavors of NDCG - normalized to what!?
• Mean reciprocal rank
• P@k
• Demystifying nDCG and ERR
• Choosing your search relevance evaluation metric
• How to Implement a Normalized Discounted Cumulative Gain (NDCG) Ranking Quality Scorer in Quepid
• https://en.wikipedia.org/wiki/Precision_and_recall
• https://en.wikipedia.org/wiki/F1_score
• Visualizing search metrics
• Choosing your search relevance evaluation metric
• Compute Mean Reciprocal Rank (MRR) using Pandas
• Recommender Systems: Machine Learning Metrics and Business Metrics

• 5 Right Ways to Measure How Search Is Performing
• E-commerce Site-Search KPIs. Part 1 – Customers, Part 2 – Products, Part 3 - Queries
• Learning from Friction to Improve the Search Experience
• Behind the Wizardry of a Seamless Search Experience
• Analyzing online search relevance metrics with the Elastic Stack
• How to Gain Insight From Search Analytics

• Measure It
• Measuring Searcher Behavior
• Using Human Judgement
• When There’s No Conversion Rate

• Statistical and human-centered approaches to search engine improvement
• A Human Approach
• Setting up a relevance evaluation program
• Metrics Matter
• A/B Testing Search: thinking like a scientist
• Query Triage: The Secret Weapon for Search Relevance
• The Launch Review: bringing it all together…

• Part 1: Findability
• part 2: Search Quality For Discovery & Inspiration

• The Art Of Abstraction – Revisiting Webshop Architecture
• Canva - Search Pipeline
  • Part One outline of the challenges faced
  • Part Two new search arcthitecture
• Event-Driven Architecture for Efficient Search Indexing

• Activate
• Berlin buzzword
• Haystack
• Elastic{ON}
• MIX-CAMP E-COMMERCE SEARCH
• SIGIR eCommerce
  • 2019
  • 2018
  • 2017

• Machine Learning Powered Search. Doug Turnbull Next: Jan 24, 2023

• OpenSource Connections

  • Elasticsearch "Think Like a Relevance Engineer"
  • Solr "Think Like a Relevance Engingeer"
  • Beyond Search Relevance: Understanding and Measuring Search Result Quality
  • Hello LTR

• Sease's trainings

• Search Fundamentals. Daniel Tunkelang, Grant Ingersoll Next: Feb 6, 2023

• Search with Machine Learning. Daniel Tunkelang, Grant Ingersoll Next: Feb 27, 2023

• Search for Product Managers. Daniel Tunkelang Next: Apr 3, 2023

• Sematext's Solr, Elasticsearch, and OpenSearch trainings

  Fall 2023

• https://dtunkelang.medium.com/upcoming-search-classes-this-fall-58f877fe00ad

• AI-powered search
• Relevant Search
• Deep Learning for search
• Interactions with search systems
• Embeddings in Natural Language Processing. Theory and Advances in Vector Representation of Meaning
• Search User Interfaces
• Search Patterns
• Search Analytics for Your Site: Conversations with Your Customers
• Click Models for Web Search
• Optimization Algorithms

• Searchnews

• List of papers

• Search is a Team Sport
• Thoughts about Managing Search Teams
• On Search Leadership
• Building an Effective Search Team: the key to great search & relevancy
• Query Triage: The Secret Weapon for Search Relevance
• The Launch Review: bringing it all together
• The Role of Search Product Owners
• Search Product Management: The Most Misunderstood Role in Search?
• Search relevance for understaffed teams

• Interview Questions for Search Relevance Engineers, Data Scientists, and Product Managers
• Data Science Interviews: Ranking and search

• Technical debt in search

• How do I know that my search is broken?
• What does it mean if my search is ‘broken’?
• How do you fix a broken search?
• Reducing business risk by optimizing search

Better search through query understanding.

• An Introduction
• Language Identification
• Character Filtering
• Tokenization
• Spelling Correction
• Stemming and Lemmatization
• Query Rewriting: An Overview
• Query Expansion
• Query Relaxation
• Query Segmentation
• Query Scoping
• Entity Recognition
• Taxonomies and Ontologies
• Autocomplete
• Autocomplete and User Experience
• Contextual Query Understanding: An Overview
• Session Context
• Location as Context
• Seasonality
• Personalization
• Search as a Conversation
• Clarification Dialogues
• Relevance Feedback
• Faceted Search
• Search Results Presentation
• Search Result Snippets
• Search Results Clustering
• Question Answering
• Query Understanding and Voice Interfaces
• Query Understanding and Chatbots

• Not your father’s search engine: a brief history of retail search
• Semantic vector search: the new frontier in product discovery
• Boosting product discovery with semantic search
• Semantic query parsing blueprint

• Intro
• Assumptions About Search
• Assumptions About User Search Behavior
• Types of Information Collections
• A Structural Look at Search
• Users and the Task of Information Retrieval
• Testing Search
• Useful Search Links and References

• Daniel Tunkelang (he is God of Search)
• Max Irwin
• Doug Turnbull
• Baymard’s Institute

• Google
• Bing
• Yandex
• Amazon
• eBay

• Algolia
• Vespa
• Elasticsearch - Distributed search & analytics engine
• Solr - Solr is the blazing-fast, open source, multi-modal search platform built on the full-text vector, and geospatial search capabilities of Apache Lucene
• Fess Enterprise Search Server
• Typesense - an opensource alternative to Algolia.
• SearchHub.io
• Datafari - an open source enterprise search solution.
• Qdrant - an open source vector database.
• Awakari - Real-Time search from unlimited sources like RSS, Fediverse, Telegram. Text keyword matching conditions, numeric conditions, condition groups. Reverse search index based.
• Meilisearch - Open source search API that supports full-text, vector, geospatial & faceted search

• OpenSource Connections
• https://sease.io/
• Sematext

• Airbnb - Machine Learning-Powered Search Ranking of Airbnb Experiences
• Airbnb - Listing Embeddings in Search Ranking
• Algolia - The Architecture Of Algolia’s Distributed Search Network
• Meituan - Exploration and practice of BERT in the core ranking of Meituan search (🇨🇳 BERT在美团搜索核心排序的探索和实践)
• Netflix - How Netflix Content Engineering makes a federated graph searchable (Part 1, Part 2)
• Netflix - Elasticsearch Indexing Strategy in Asset Management Platform (AMP)
• Skyscanner - Learning to Rank for Flight Itinerary Search
• Slack - Search at Slack
• Twitter - Stability and scalability for search
• Amazon SEO Explained: How to Rank Your Products #1 in Amazon Search Results in 2020
• Building a Better Search Engine for Semantic Scholar

• How Bing Ranks Search Results: Core Algorithm & Blue Links
• How Google Search Ranking Works – Darwinism in Search

• Searchandising

• Discover How Cassini (The eBay Search Engine) Works and Rank

Apache Solr Short Tips

• Lucid Thoughts
• Lucidworks
• MIx-Camp E-commerce Search
• OpenSource Connections
• SIGIR eCom

• Relevant Facets

• Shopping Queries Dataset: A Large-Scale ESCI Benchmark for Improving Product Search
• ESCI-S: extended metadata for Amazon ESCI dataset
• Home Depot Product Search Relevance
• WANDS - Wayfair ANnotation Dataset

Awesome Spacy - Natural language upderstanding, content enrichment etc.

• Word2Vec For Phrases — Learning Embeddings For More Than One Word
• Gensim Word2Vec Tutorial
• How to incorporate phrases into Word2Vec – a text mining approach
• Word2Vec — a baby step in Deep Learning but a giant leap towards Natural Language Processing
• How to Develop Word Embeddings in Python with Gensim

• Query Segmenter
• https://github.com/zentity-io/zentity
• https://github.com/mammothb/symspellpy
• https://github.com/searchhub/search-collector
• Kiri - State-of-the-art semantic search made easy.
• Haystack - End-to-end Python framework for building natural language search interfaces to data.
• https://github.com/castorini/docTTTTTquery

• Chorus, Smui, Querqy
• Quepid
• Rated Ranking Evaluator
• Jina AI - A neural search framework

• Awesome Knowledge Graphs
• Awesome time series
• Awesome Spacy
• Query-Understanding
• Click models