Shazam is a widely used tool for identifying songs. Audiophiles on their phones benefit from its instant song recognition, but movies don’t have an equivalent. If you see a scene in a waiting room or online, you’ll need to search for key details, check comments, or hope someone else knows it.
There aren’t many moments when you need a movie recognition app. A dedicated one might sit unused most of the time. We have Circle to Search, which could integrate deeper video recognition for when you need it. It’s a small change that could make a big difference, and here’s why it should happen.
How Google missed the chance to make a movie finder
To find that show with the guy from that other show
Circle to Search is a powerful tool for detecting objects, text, and some people in images and videos. It allows you to highlight items on your screen and get relevant search results. It works well for identifying products, landmarks, or celebrities. It works the same way for movies, which is impressive. But, rather than tell you what scene the movie is from, it focuses on details within the scene.
If you test it on motion pictures, you’ll likely get results related to the designer purse an actress is carrying rather than the name of the film or the character and their role. It’s a missed opportunity to turn the feature into a film identifier, considering that the technology can scan faces and objects.
Google has extensive databases of movies, actors, and metadata from IMDb and Wikipedia, among other sources. It wouldn’t be a huge leap for Circle to Search to analyze visual elements and cross-reference them with known clips.
Why aren’t movie finder apps popular?
Because movies can’t sit still long enough to be fingerprinted
It’s easier for machines to identify music because songs have unique audio fingerprints. A short snippet of a track has specific tones, rhythms, and harmonies that can be matched against a large database. If you play Queen’s iconic Bohemian Rhapsody, the Shazam app guesses it in seconds if you have a strong internet connection.
The composition is layered with vocal harmonies, operatic sections, and dramatic shifts in pitch and tempo. Don’t forget Brian May’s incredible guitar solo, tone, and phrasing. Technically, the app doesn’t hear these elements. Instead, it analyzes their consistency across different recordings to pinpoint the exact track. So it matters less if it plays on vinyl, Spotify, or a commercial.
On the other hand, movies are more complex. A single film carries countless frames with different lighting, camera angles, and color grades that change from scene to scene. Even within one movie, the same scene might be shot in multiple versions or edited for various regions.
There’s also the issue of how production studios, streaming platforms, and distributors hold rights. There isn’t a comprehensive source for film metadata. It’s not surprising that most apps would end up confused. Although challenging, it’s not impossible.
Related
The best new movies you can watch at home right now
There’s plenty to watch at home these days, and we’re rounding up the best (and worst) movies you can stream
Google doesn’t have to start from scratch
What TheTake and Amazon can teach them
TheTake proves that movie identification is not just practical. It’s been done. The Shazam-inspired app is targeted toward shoppers who want to recreate on-screen fashion. It can also observe different content you provide to find an exact movie match using artificial intelligence, audio detection, deep learning, and Automatic Content Recognition (ACR).
Its integrable Application Programming Interface (API) is also a boon for platforms interested in adding the app’s system to existing solutions. It’s worth noting that all these services were available in 2014. If TheTake could do this over a decade ago with limited AI, Google could integrate similar functionality into Circle to Search and Google Lens. The company’s AI tools are excellent at image and object recognition. The missing piece is scene-based indexing.
Amazon Prime Video is another example Google could learn from. Its X-Ray feature is built into the streaming experience. It shows a movie’s cast and soundtrack and offers trivia during playback.
Become a movie detective
You have alternatives when you want to know what you’re watching. Google Lens is one option. It picks up on faces, text, or objects in a scene. Though its accuracy can be hit or miss. A community-driven approach is turning to subreddits. r/tipofmytongue and r/NameThatMovie are my favorites. These forums are filled with film enthusiasts who enjoy the challenge of finding movies. It also helps if you remember a direct quote from the movie. A memorable line can be a powerful clue.
