DEV Community

Cover image for OpinionFlow – Real-Time Review Intelligence with Bright Data, Gemini 2.0 & Pinecone

OpinionFlow – Real-Time Review Intelligence with Bright Data, Gemini 2.0 & Pinecone

Shivansh Singh on May 26, 2025

This is a submission for the Bright Data AI Web Access Hackathon 🔥 What I Built OpinionFlow helps users skip the endless scroll. It'...
Collapse
 
dotallio profile image
Dotallio

Super cool seeing live reviews merged with quick AI insights like this. Any plans to add more stores or deeper personalization next?

Collapse
 
shivanshsinghh profile image
Shivansh Singh

Thank you so much for your comment. Yes I am thinking to add more stores and do deeper personalizations in this project. This project really resonates with me.

Collapse
 
jennysa21 profile image
Jenny Sa

Good work

Collapse
 
shivanshsinghh profile image
Shivansh Singh

Thank you

Collapse
 
bahmansimonn profile image
Bahman Simon

Great work shivansh, thanks for sharing this

Collapse
 
shivanshsinghh profile image
Shivansh Singh

Really appreciate that - it was a fun challenge putting all together.

Collapse
 
shagun_singh_ac41877ec7d8 profile image
Shagun Singh

Great work as always!!

Collapse
 
shivanshsinghh profile image
Shivansh Singh

Thanks for always showing up and supporting. Means a lot!

Collapse
 
divyanshsinghh profile image
Info Comment hidden by post author - thread only accessible via permalink
Divyansh Singh

Thanks for sharing this sir!
Very great work❣️

Collapse
 
divyanshsinghh profile image
Divyansh Singh

Top-notch work! Sir

Collapse
 
nathan_tarbert profile image
Nathan Tarbert

pretty cool seeing tools get tied together like this - makes me curious, you think momentum on stuff like this depends more on habits or just chasing little wins day by day?

Collapse
 
shivanshsinghh profile image
Shivansh Singh

Thanks! Honestly, I think it's a mix of both - I definitely chase small wins to stay motivated, but a lot of it also just comes from long-term habits. I've been coding since I was a kid, so some of that momentum is just muscle memory at this point.

Collapse
 
daliudi profile image
Dalimin Iswahyudi

Honestly didn’t think something like this could be built in a hackathon timeframe. Hats off!

Collapse
 
scott_1209 profile image
Scott Peralta

Fabulous this is! Such a life saver. Good work!

Collapse
 
shivanshsinghh profile image
Shivansh Singh

Thank you so much! Glad to hear it's helpful to you. Let me know if you try it out!

Collapse
 
nitya_bhardwaj_7189adc360 profile image
Nitya Bhardwaj

This is such a cool use of Ai and web scrapping.. something like this can save so much time and efforts of users. Great stuff man!

Collapse
 
shivanshsinghh profile image
Shivansh Singh

I'm glad you liked it! Thanks for commenting.

Collapse
 
tomasreuteraf profile image
Tomas Reuter

Would love to see multilingual support in future, you are currently looking for amazon.com but they have different variants for different countries. So maybe you can try to look at or detect user's location and then connect to amazon or walmart. BTW! really great work.

Collapse
 
pedrorez profile image
Pedro Rodriguez

What stood out to me is how you have aligned semantic caching with product discovery - it felt like the kind of detail that only comes from actually building and testing products deeply.

Thank you again!

Collapse
 
shivanshsinghh profile image
Shivansh Singh

Woow, appreciate that insight - yes caching was the trickiest part in this. Took a few iterations to get the key structure right. Pinecone is great too

Collapse
 
chokhchwy profile image
เขมจิรา เกตุอารี

Absolutely loved the clarity of the summaries — way better than skimming 100+ reviews. You’ve nailed both utility and presentation

Collapse
 
shivanshsinghh profile image
Shivansh Singh

Thanks so much - took a tweaking to make Gemini return clean and accurate summaries. Glad it's working as intended!

Collapse
 
mathias95 profile image
Cyril de Cock

Just saw your linkedin post, and wanted to really thank you for this creation.

Collapse
 
matilova profile image
Matilda Sobotková

Was it tough to parse the HTML across different stores like Walmart and Amazon?

Collapse
 
shivanshsinghh profile image
Shivansh Singh

100%. Every store has different DOMs, lazy loading, and anti-bot tricks. The use of browser api, and other servies from Brightdata made it easy to extract information.

Collapse
 
tugimaon profile image
Tugiman Tampubolon

Quick question: does the Gemini analysis handle multilingual reviews? Or is it limited to English for now?

Collapse
 
shivanshsinghh profile image
Shivansh Singh

Currently it's mostly tuned for English, though Gemini does handle multilingual reasonably well. Planning to test with Hindi and Spanish next to see how it holds up.

Collapse
 
andrsov profile image
Andres Kuznetsov

Would it be possible to let users upload a product URL from any store and get analysis instantly? That would make this even more flexible.

Collapse
 
shivanshsinghh profile image
Shivansh Singh

Yes! I've already built in support for direct URLs. Would be live soon!

Collapse
 
johnmohar profile image
John Montahar

Great work. I also applied to this hackathon, but couldn't finalize the end product. Great to see how you finalized this project.

Collapse
 
shivanshsinghh profile image
Shivansh Singh

Totally get that - sometimes it just doesn't click in time. Hope you jump back into the next one!

Collapse
 
suleymurk profile image
Süleyman Öztürk

Just used the live demo — the way it breaks down pros/cons and sentiment across stores is honestly more helpful than most YouTube review videos lol.

Collapse
 
shivanshsinghh profile image
Shivansh Singh

Hahah I'll take that as a big win. Glad you liked it!

Collapse
 
michakaalakoswa profile image
Michalina Laskowska

The way it summarizes real user sentiment into a one-liner is impressive. Curious — how long does it take from query to final answer?

Collapse
 
fletcll profile image
Fletcher Mitchell

One suggestion: showing the last scraped timestamp for each store would build a lot of user trust. Just a little ‘Fresh as of…’ badge maybe?

Collapse
 
shivanshsinghh profile image
Shivansh Singh

Love this and totally agree. Adding a "Last updated: X mins ago" badge per store is actually super simple to implement with current cache structure. Will try to ship that next !

Collapse
 
amit_kashyap_d50761cebf2f profile image
Amit Kashyap

How you integrated Amazon review scrapping in this? BTW project looks solid.

Collapse
 
shivanshsinghh profile image
Shivansh Singh

You can find Amazon Review extractors in Bright Data - Web Scraper for Amazon

Collapse
 
jorgevacia profile image
Jorge Valencia

Super clean interface - loved it

Collapse
 
nancyalave213 profile image
Nancy Alave

This is incredibly helpful for comparison shoppers like me! Any plans to add Flipkart or BestBuy next?

Collapse
 
shivanshsinghh profile image
Shivansh Singh

The scraping structure is modular, so Flipkart and BestBuy are 90% ready - just need to fine-tune HTML selectors and test a few edge cases.

Collapse
 
estevale profile image
Estêvão Delvalle

Maybe in future versions, you could allow users to contribute their own reviews and see how Gemini classifies them?”

Collapse
 
shivanshsinghh profile image
Shivansh Singh

Ooh I really like that! Like a sandbox mode for testing your own feedback - thanks for the idea, bookmarking it.

Collapse
 
backslash_flutter_032b58a profile image
BackSlash Flutter

Great work

Collapse
 
shivanshsinghh profile image
Shivansh Singh

Thank you! Really appreciate your time to check this out

Collapse
 
pannaantal profile image
Panna Antal

I didn’t even know Pinecone could be used like this. Thanks for showcasing how semantic search can power something practical like this.

Collapse
 
shivanshsinghh profile image
Shivansh Singh

Absolutely! That's what I was aiming for - real-world usage that just goes beyond the demos. Happy you found it interesting!

Collapse
 
simonendt profile image
Simone Brandt

Curious how LangChain fits into the final RAG flow — are you using custom retrievers?

Collapse
 
shivanshsinghh profile image
Shivansh Singh

Yes- I'm using Langchain to orchestrate the retrieval and prompting. The retriever pulls from Pinecone using cosine similarity and then fiilters based on metadata like store+timestamp before the Gemini call.

Collapse
 
oxinoer profile image
Охинбархаг Doe

Хөөе энэ үнэхээр гайхалтай.

Collapse
 
shivanshsinghh profile image
Shivansh Singh

Баярлалаа! Thank you so much — appreciate the love!

Collapse
 
marianad190 profile image
Mariana Silva

Great project, wishing you luck for this hackathon!

Collapse
 
yixuanhe12 profile image
Yixuan He

Sometimes the website shows, error loading analysis

Collapse
 
bergnaumdallas241 profile image
力 叶

Happened with me too! But then I guess now it's working.

Collapse
 
ivainmarin profile image
Ivan Marin

This is the kind of thing I’d actually use before buying anything online. Let me know when you launch a full version!

Collapse
 
shivanshsinghh profile image
Shivansh Singh

That made my day! I;m polishing the UI and will definitely drop an update once it's product-ready.

Collapse
 
lucasalert profile image
Lucas Lambert

Loved the demo! Would be cool to know how Pinecone handles paraphrased or fuzzy queries. Does it match on semantic similarity only?

Collapse
 
shivanshsinghh profile image
Shivansh Singh

Yes exactly - it works on embeddings, so even if oyu say "best wireless earbuds" and someone says "top bluetooth headphones", it knows to match based on meaning, not words. Super powerful!

Collapse
 
sofiardmyimage profile image
Sofia Meldgaard

This feels like ChatGPT with a memory — but for ecommerce reviews. Great job!

Collapse
 
veninov profile image
Вениамин Смирнов

Оцените пошаговое руководство. Пользовательский интерфейс интуитивно понятен и не кажется перегруженным.

Collapse
 
shivanshsinghh profile image
Shivansh Singh

Большое спасибо! Appreciate the feedback — I worked hard to keep the UI clean and beginner-friendly.

Collapse
 
elihaconrleis profile image
Eliah Cornelis

Question: How do you manage inconsistencies in review formats between stores? I imagine Amazon and Walmart have very different structures.

Collapse
 
joschchta profile image
Joshua Albrecht

One idea: could be awesome to let users upvote or bookmark the most relevant insights per product. Adds a human layer on top of AI

Collapse
 
shivanshsinghh profile image
Shivansh Singh

Yes! That would make it more community driven and help get most out of it.

Collapse
 
valbefa profile image
Valbona Sefa

One thing I’d love to see is a timeline feature — like how sentiment shifts over time for a product as updates roll out or versions change.

Collapse
 
shivanshsinghh profile image
Shivansh Singh

Yes yes yes — time-based review analysis is one of my favorite ideas. Currently the backend already stores timestamps per review, so i can do sentiment shifts over weeks/months. Thanks for commenting

Collapse
 
bergnaumdallas241 profile image
力 叶

Would love to see how it handles products with thousands of variants. Great job Shivansh!

Collapse
 
shivanshsinghh profile image
Shivansh Singh • Edited

That's definitely a trick part! Right now, it clusters reviews at the product level, but doesn't differentiate by variant (like size or color).

Collapse
 
toniar914 profile image
Toni Raić-Sudar

That semantic caching with Hugging Face is super interesting. Do you embed each review separately or batch them by product?

Collapse
 
shivanshsinghh profile image
Shivansh Singh

Great question - I batch them by product for now, since it makes Gemini's job easier too. Thinking of switching to per-review embedding for more granular analysis later on.

Collapse
 
antonore profile image
Antonio Fiore

Honestly surprised at how polished this is. The backend flow makes sense and the front-end is clean too. Respect.

Collapse
 
shivanshsinghh profile image
Shivansh Singh

That means a lot - thank you! It took a lot of iterations to get it this clean. Happy the backend/frontend flow felt smooth to you.

Collapse
 
renesimek profile image
René Šimek

Could be intereting to integrate price tracking next. This way intelligence + price tracking would be really good.

Collapse
 
victorson12 profile image
Victor Svensson

Brooo this is insane 🔥🔥 I remember when you were just sketching this out — now it’s a full-blown AI system with caching and scraping and everything. Let’s gooo!

Collapse
 
shivanshsinghh profile image
Shivansh Singh

Man that means a ton! You've seen the whole journey, from doodles to delivery. Appreciate you cheering me on the way!

Collapse
 
philipposmykstudio profile image
Philip M Posmyk

Tried searching for 'MacBook Air' — worked beautifully. Would be great to export reviews too!

Collapse
 
shivanshsinghh profile image
Shivansh Singh

Great to hear that! Expoert is a solid idea - CSV or PDF maybe? I'll see how I can fit it into the next sprint.

Some comments have been hidden by the post's author - find out more