How Pluck Extracts Recipes from
Videos, Photos & Social Media
Many recipe apps can now import a TikTok or Instagram post, but most read only the caption, and some add the audio. Pluck uses five AI extraction modes together to turn cooking videos, Instagram Reels, TikTok clips, photo carousels and even handwritten recipe cards into clean, structured recipes.
Share or paste a link
Send a cooking video or photo carousel from Instagram, TikTok, YouTube, or Facebook. Or upload a photo.
AI analyzes everything
Pluck watches the video, listens to narration, reads on-screen text, and parses captions - all at once.
Review and save
Get a complete recipe with ingredients, instructions, and a confidence score. Long videos keep processing in the background, and you get a notification when the recipe is ready. Edit if needed and save.
Five extraction modes, one complete recipe
Each mode captures different evidence from the source. Pluck combines all five, so when one source is missing or wrong, the others fill the gap.
Video Frame Analysis
Pluck watches the video so you don't have to pause and screenshot.
Most cooking videos show ingredients being measured, poured, and combined - but the recipe is never written down. Pluck's AI samples key frames from the video at intelligent intervals, identifies ingredients and cooking actions on screen, and reconstructs the full recipe from the visual evidence.
How it works:
- Pluck downloads the video and extracts key frames at strategic intervals - scene changes, close-ups of ingredients, and plating shots.
- Multi-modal AI analyzes each frame to identify ingredients, quantities (measuring cups, spoons), and cooking techniques.
- The AI cross-references visual evidence across frames to build a complete ingredient list and step-by-step instructions.
Competitor gap: Most apps with video import read the caption, and ReciMe and Honeydew also transcribe the audio. Of the apps we checked, only Deglaze also says it reads frames and on-screen text. The rest never look at the picture, so an ingredient that's only shown is lost.
Apps we found no sign of this in (October 2026): ReciMe, Flavorish, Paprika, Mela, Pestle, Honeydew, Recipe Keeper, NYT Cooking
Audio Transcription
When the creator says "a pinch of salt," Pluck hears it.
Many cooking videos communicate critical details through narration - "add a generous tablespoon of olive oil," "let it simmer for about 20 minutes," "season to taste with salt and pepper." These spoken instructions often contain details that never appear on screen or in captions. Pluck transcribes the full audio track and feeds it to the AI alongside the visual data.
How it works:
- The audio track is extracted from the video and processed through a speech-to-text model optimized for cooking vocabulary.
- The transcription captures ingredient mentions, quantities, timing cues, temperatures, and technique descriptions.
- The AI merges spoken instructions with visual evidence from frame analysis to fill gaps and resolve ambiguities.
Competitor gap: Audio is no longer unique to Pluck: ReciMe, Honeydew and Deglaze also transcribe it, and Flavorish's release notes mention audio transcription. Caption-first apps like Mela and Pestle miss anything that's only said out loud.
Apps we found no sign of this in (October 2026): Paprika, Mela, Pestle, Recipe Keeper, NYT Cooking
On-Screen Text Recognition (OCR)
Ingredient lists flashed on screen for 2 seconds? Pluck catches them.
Content creators frequently overlay text on their videos - ingredient lists, step numbers, temperatures, cooking times, and recipe titles. These text overlays appear for a few seconds and are easy to miss. Pluck's OCR capabilities read every piece of on-screen text, including stylized fonts, handwritten annotations, and multi-language text.
How it works:
- During frame analysis, the AI identifies and reads all text overlays, captions, and on-screen graphics.
- OCR runs on every sampled frame, capturing ingredient lists, quantities, and instructions that appear briefly on screen.
- Extracted text is cross-referenced with audio and visual data to validate accuracy and resolve conflicts.
Competitor gap: Deglaze says it reads on-screen text frame by frame too. Apps with photo scanning (Mela, Pestle, Recipe Keeper) read still images, not text that flashes up inside a video.
Apps we found no sign of this in (October 2026): ReciMe, Flavorish, Paprika, Mela, Pestle, Honeydew, Recipe Keeper, NYT Cooking
Caption & Subtitle Parsing
Captions are a starting point - but Pluck doesn't stop there.
Platform-generated captions and creator-provided subtitles are the easiest source of recipe information. Pluck parses them as a first pass, but treats captions as supplementary data - not the primary source. This matters because auto-generated captions frequently misspell ingredient names, miss quantities, and garble cooking terminology. Pluck uses captions alongside video, audio, and OCR data for a complete picture.
How it works:
- Pluck fetches available captions and subtitles from the platform (YouTube auto-captions, TikTok text, Instagram captions).
- The AI parses the caption text for recipe-relevant content - ingredients, steps, and contextual notes.
- Caption data is merged with frame analysis, audio transcription, and OCR results, with higher-confidence sources taking priority when conflicts arise.
Competitor gap: Most apps with social import read the caption: ReciMe, Flavorish, Mela, Pestle, Honeydew, Deglaze and Recipe Keeper all do. The difference is what happens when the caption is empty or just says "recipe in bio": a caption-only app has nothing else to go on.
Apps we found no sign of this in (October 2026): Paprika, NYT Cooking
Image & Photo Extraction
Recipe card, cookbook page, or just a photo of the dish? Pluck handles all of them.
Not every recipe comes from a video. Pluck also handles static images - photos of handwritten recipe cards, screenshots of recipes from social media, scanned pages from cookbooks, and images shared in group chats. The AI reads handwriting, printed text, and even messy kitchen-stained recipe cards to produce a clean, structured digital recipe. And if you snap a photo of a finished dish - no recipe text at all - Pluck identifies what it is and generates a best-guess recipe with realistic ingredients and instructions.
How it works:
- Upload or share a photo directly to Pluck - handwritten cards, cookbook pages, screenshots, or even just a photo of a plated dish.
- The AI analyzes the image using OCR and visual understanding. For recipe text, it extracts the title, ingredients, quantities, and instructions. For food photos, it identifies the dish and generates a complete best-guess recipe.
- The extracted recipe is structured into Pluck's standard format with editable fields and a confidence score, so you can review and adjust before saving.
Competitor gap: Photo import is common now: ReciMe, Flavorish, Honeydew, Deglaze and Pestle read recipe photos, and Mela and Recipe Keeper scan with OCR. Flavorish and Honeydew can also suggest a recipe from a photo of a dish. Pluck does both, and reads handwriting.
Apps we found no sign of this in (October 2026): Paprika, NYT Cooking
Why multi-modal extraction matters
A TikTok cooking video might show ingredients being measured (visual), say "about two cups of flour" (audio), flash "2 cups all-purpose flour" on screen for three seconds (OCR), and have a caption that just says "flour" (text). No single source tells the full story. Pluck's AI cross-references all five extraction modes to produce the most complete recipe it can.
Caption-only import
- Reads the caption or description only
- Misses spoken instructions
- Can't see what's happening on screen
- Has nothing to work with when the caption is empty
Pluck (yes, we're biased)
- Combines video, audio, OCR, captions, and images
- Cross-validates data across sources
- Handles missing or conflicting information
- Produces complete recipes with confidence scores
Frequently asked questions
How accurate is Pluck's AI recipe extraction?
Pluck uses multi-modal AI that combines evidence from multiple sources - video frames, audio, on-screen text, and captions - to cross-check the extracted recipe, so a gap in one source can be filled from another. Each extraction includes a confidence score so you know how reliable the result is, and you can edit anything before saving.
Which social media platforms does Pluck support?
Pluck extracts recipes from Instagram (posts, Reels and photo carousels), TikTok (videos and photo slideshows), YouTube (full videos and Shorts), Facebook (posts, videos and Reels), and any website with recipe content. Share directly from any of these apps using the share menu, or paste a URL. You can also extract from photos and screenshots.
What happens if the AI can't fully extract a recipe?
Pluck shows you a confidence score for each extraction. If the AI is uncertain about specific ingredients or steps, those fields are flagged for your review. You can edit any part of the extracted recipe before saving it to your recipe box.
Do I need a paid plan to use AI extraction?
Pluck's free tier includes 3 AI extractions per month - enough to try it out. The Light plan ($2.99/mo) gives you 10 extractions and the AI cooking assistant. The Plus plan ($6.99/mo) gives you 50 extractions, and the Pro plan ($11.99/mo) gives you 200. All tiers use the same multi-modal AI technology.
How is Pluck different from apps that "support" video recipes?
Apps that "support" video read different things. Mela and Pestle read the caption or description. ReciMe and Honeydew add the audio transcript. Deglaze says it also reads on-screen text. Pluck's five extraction modes (frame analysis, audio transcription, OCR, caption parsing, and image extraction) work together to reconstruct the recipe from everything the creator shows and says - not just what's written in a caption.
Can Pluck extract recipes from handwritten recipe cards?
Yes. Pluck's image extraction mode can read handwritten recipe cards, cookbook pages, and scanned documents. The AI handles different handwriting styles, faded ink, and kitchen-stained cards. Take a photo with your phone and Pluck will produce a clean digital recipe you can edit and save.
Can Pluck create a recipe from just a photo of food?
Yes. If you upload a photo of a finished dish - a plate at a restaurant, something a friend cooked, food from a delivery app - Pluck identifies what it is and generates a best-guess recipe with realistic ingredients, quantities, and step-by-step instructions. The recipe is labeled as a best guess with a lower confidence score so you know to taste-test and tweak.
What can I do with a recipe once it's saved?
Every recipe is fully editable and lives in your recipe box, with search, tags, groups and offline access. You can add it to your weekly meal plan, build a grocery list sorted by aisle and share that list with your household, cook from it step by step in cook mode, share it as a link, and find it with "What can I cook?" by typing the ingredients you have or taking a photo of your fridge. On paid plans the AI cooking assistant can scale, convert or translate it.
Explore more
See it in action - try Pluck free
Pluck is available on iOS and Android. Try multi-modal AI recipe extraction today.
Free tier includes 3 extractions per month. No credit card required. Or try our free web recipe extractor right now - no app needed.