2025-03-31 00:32:22 [scrapy.utils.log] INFO: Scrapy 2.12.0 started (bot: zomato_competiton_analysis) 2025-03-31 00:32:22 [scrapy.utils.log] INFO: Versions: lxml 5.3.0.0, libxml2 2.12.9, cssselect 1.2.0, parsel 1.9.1, w3lib 2.2.1, Twisted 24.11.0, Python 3.10.12 (main, Feb 4 2025, 14:57:36) [GCC 11.4.0], pyOpenSSL 24.3.0 (OpenSSL 3.4.0 22 Oct 2024), cryptography 44.0.0, Platform Linux-6.8.0-1015-aws-aarch64-with-glibc2.35 2025-03-31 00:32:22 [scrapy.addons] INFO: Enabled addons: [] 2025-03-31 00:32:22 [asyncio] DEBUG: Using selector: EpollSelector 2025-03-31 00:32:22 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor 2025-03-31 00:32:22 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop 2025-03-31 00:32:22 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor 2025-03-31 00:32:22 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop 2025-03-31 00:32:22 [scrapy.extensions.telnet] INFO: Telnet Password: b7dbf486abbec1d1 2025-03-31 00:32:22 [scrapy.middleware] INFO: Enabled extensions: ['scrapy.extensions.corestats.CoreStats', 'scrapy.extensions.telnet.TelnetConsole', 'scrapy.extensions.memusage.MemoryUsage', 'scrapy.extensions.logstats.LogStats', 'scrapeops_scrapy.extension.ScrapeOpsMonitor'] 2025-03-31 00:32:22 [scrapy.crawler] INFO: Overridden settings: {'BOT_NAME': 'zomato_competiton_analysis', 'DOWNLOAD_DELAY': 3, 'DOWNLOAD_TIMEOUT': 30, 'FEED_EXPORT_ENCODING': 'utf-8', 'LOG_FILE': '/home/ubuntu/restaverse_spiders/logs/zomato_competiton_analysis/reviews/zomato ' 'competitor analysis reviws_2025-03-31T00_30_02.log', 'NEWSPIDER_MODULE': 'zomato_competiton_analysis.spiders', 'RETRY_HTTP_CODES': [500, 502, 503, 504, 408], 'RETRY_TIMES': 5, 'SPIDER_MODULES': ['zomato_competiton_analysis.spiders'], 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor'} 2025-03-31 00:32:22 [scrapy.middleware] INFO: Enabled downloader middlewares: ['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware', 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware', 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware', 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware', 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware', 'scrapeops_scrapy.middleware.retry.RetryMiddleware', 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware', 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware', 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware', 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware', 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware', 'scrapy.downloadermiddlewares.stats.DownloaderStats'] 2025-03-31 00:32:22 [scrapy.middleware] INFO: Enabled spider middlewares: ['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware', 'scrapy.spidermiddlewares.referer.RefererMiddleware', 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware', 'scrapy.spidermiddlewares.depth.DepthMiddleware'] 2025-03-31 00:32:22 [scrapy.middleware] INFO: Enabled item pipelines: ['zomato_competiton_analysis.pipelines.ZomatoCompetionAnalysisPipeline'] 2025-03-31 00:32:22 [scrapy.core.engine] INFO: Spider opened 2025-03-31 00:32:22 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-03-31 00:32:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-31 00:32:23 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/setup/ HTTP/11" 200 None 2025-03-31 00:32:23 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023 2025-03-31 00:32:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): cron.restaverse.com:443 2025-03-31 00:32:23 [urllib3.connectionpool] DEBUG: https://cron.restaverse.com:443 "POST /api/db_services/fetch-query HTTP/11" 200 34101 2025-03-31 00:32:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-31 00:32:24 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/normalizer/proxy_port/?job_id=3621554 HTTP/11" 200 None 2025-03-31 00:32:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-31 00:32:24 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/normalizer/domain/?domain=zomato.com HTTP/11" 200 241 2025-03-31 00:32:27 [scrapy.core.engine] DEBUG: Crawled (400) (referer: None) 2025-03-31 00:32:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:32:28 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381145, 'download_latency': 0.9281783103942871, 'depth': 0} 2025-03-31 00:32:28 [reviews] INFO: Scraped item: {'review': 'Our server Parag Lama was an excellent host and made our experience exceptional.', 'review_id': 291181383, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947} 2025-03-31 00:32:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=947&page=1> {'review': 'Our server Parag Lama was an excellent host and made our experience exceptional.', 'review_id': 291181383, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947} 2025-03-31 00:32:28 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290915527, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947} 2025-03-31 00:32:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=947&page=1> {'review': '', 'review_id': 290915527, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947} 2025-03-31 00:32:28 [reviews] INFO: Scraped item: {'review': 'My first ever visit to this restaurant and it did not disappoint. The portion size was good. The Dimsums were succulent and appetising.
The noodles were tangy and flavourful.
Overall vibe was great. A solid 4.5/5', 'review_id': 290356134, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-27', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947} 2025-03-31 00:32:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=947&page=1> {'review': 'My first ever visit to this restaurant and it did not disappoint. The portion size was good. The Dimsums were succulent and appetising.
The noodles were tangy and flavourful.
Overall vibe was great. A solid 4.5/5', 'review_id': 290356134, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-27', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947} 2025-03-31 00:32:28 [reviews] INFO: Scraped item: {'review': 'Stale and very badly made. Not used to this quality from Mamagoti', 'review_id': 290354238, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947} 2025-03-31 00:32:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=947&page=1> {'review': 'Stale and very badly made. Not used to this quality from Mamagoti', 'review_id': 290354238, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947} 2025-03-31 00:32:28 [reviews] INFO: Scraped item: {'review': "Mamagoto has been my Chinese fav for years specifically the black bean sauce and eatan several times the quality of the sauce in the order was so watery not at all like it's served in the restaurant little disappointed", 'review_id': 290033545, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947} 2025-03-31 00:32:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=947&page=1> {'review': "Mamagoto has been my Chinese fav for years specifically the black bean sauce and eatan several times the quality of the sauce in the order was so watery not at all like it's served in the restaurant little disappointed", 'review_id': 290033545, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947} 2025-03-31 00:32:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:32:32 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381145, 'download_latency': 0.725135087966919, 'depth': 0} 2025-03-31 00:32:32 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291757375, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835} 2025-03-31 00:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32835&page=1> {'review': '', 'review_id': 291757375, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835} 2025-03-31 00:32:32 [reviews] INFO: Scraped item: {'review': "soup was good but it's too much expensive plz make rate reasonable price ๐Ÿ˜ž u r shop one of the best in mumbai but u putting to expensive rate of ever item we humbly request you Persian darbar management make reasonable price to buy middle class people also my Allah swt grant you with lots of success and prosperity in your restaurant ameen ya rabbul alamin ", 'review_id': 291747632, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835} 2025-03-31 00:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32835&page=1> {'review': "soup was good but it's too much expensive plz make rate reasonable price ๐Ÿ˜ž u r shop one of the best in mumbai but u putting to expensive rate of ever item we humbly request you Persian darbar management make reasonable price to buy middle class people also my Allah swt grant you with lots of success and prosperity in your restaurant ameen ya rabbul alamin ", 'review_id': 291747632, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835} 2025-03-31 00:32:32 [reviews] INFO: Scraped item: {'review': 'chicken crispy is stale not even edible smelling very bad', 'review_id': 291704552, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835} 2025-03-31 00:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32835&page=1> {'review': 'chicken crispy is stale not even edible smelling very bad', 'review_id': 291704552, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835} 2025-03-31 00:32:32 [reviews] INFO: Scraped item: {'review': 'Superb quality food great', 'review_id': 291651693, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835} 2025-03-31 00:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32835&page=1> {'review': 'Superb quality food great', 'review_id': 291651693, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835} 2025-03-31 00:32:32 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291571642, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835} 2025-03-31 00:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32835&page=1> {'review': '', 'review_id': 291571642, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835} 2025-03-31 00:32:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:32:35 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 32971, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381145, 'download_latency': 0.7049429416656494, 'depth': 0} 2025-03-31 00:32:35 [reviews] INFO: Scraped item: {'review': "Sorry to advise but the original and replacement were both substandard. I don't feel the items were suitably grilled Infact meat had a pan fry feeling rather than grill", 'review_id': 291670616, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 32971} 2025-03-31 00:32:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32971&page=1> {'review': "Sorry to advise but the original and replacement were both substandard. I don't feel the items were suitably grilled Infact meat had a pan fry feeling rather than grill", 'review_id': 291670616, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 32971} 2025-03-31 00:32:35 [reviews] INFO: Scraped item: {'review': 'Ab-E-Hayat Veg Soup, Mango Mocktail, Dahi Wada, Kashmiri Raita, Pani Puri, Veg Biriyani, Dal Maharaja, Butter Naan, Angoori Rasagulla, Mango Icecream, etc. were all a treat to remember for Gudi Padwa lunch. Thank you.', 'review_id': 291506981, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 32971} 2025-03-31 00:32:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32971&page=1> {'review': 'Ab-E-Hayat Veg Soup, Mango Mocktail, Dahi Wada, Kashmiri Raita, Pani Puri, Veg Biriyani, Dal Maharaja, Butter Naan, Angoori Rasagulla, Mango Icecream, etc. were all a treat to remember for Gudi Padwa lunch. Thank you.', 'review_id': 291506981, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 32971} 2025-03-31 00:32:35 [reviews] INFO: Scraped item: {'review': 'Great food (we had รก la carte) and atmosphere. We had a Sunday brunch with the kids and Ankit and Nitin were really kind and attentive. They made it feel like home๐Ÿ™๐Ÿพ Thank you both!', 'review_id': 291499195, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 32971} 2025-03-31 00:32:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32971&page=1> {'review': 'Great food (we had รก la carte) and atmosphere. We had a Sunday brunch with the kids and Ankit and Nitin were really kind and attentive. They made it feel like home๐Ÿ™๐Ÿพ Thank you both!', 'review_id': 291499195, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 32971} 2025-03-31 00:32:35 [reviews] INFO: Scraped item: {'review': 'I paid for a table. but no confirmation
please refund ', 'review_id': 291474755, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 32971} 2025-03-31 00:32:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32971&page=1> {'review': 'I paid for a table. but no confirmation
please refund ', 'review_id': 291474755, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 32971} 2025-03-31 00:32:35 [reviews] INFO: Scraped item: {'review': 'Not bad at all but nothing great worth mentioning either. Very average.', 'review_id': 291111142, 'rating': '3', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 32971} 2025-03-31 00:32:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32971&page=1> {'review': 'Not bad at all but nothing great worth mentioning either. Very average.', 'review_id': 291111142, 'rating': '3', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 32971} 2025-03-31 00:32:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-31 00:32:38 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-31 00:32:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:32:39 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381145, 'download_latency': 0.7290475368499756, 'depth': 0} 2025-03-31 00:32:39 [reviews] INFO: Scraped item: {'review': 'you guys never follow any instructions or notes given by us... simply asked u to not to make it oily..what u guys gave me...oil was floating on the rice..that much oil u have used to prepare it....', 'review_id': 291774694, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052} 2025-03-31 00:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34052&page=1> {'review': 'you guys never follow any instructions or notes given by us... simply asked u to not to make it oily..what u guys gave me...oil was floating on the rice..that much oil u have used to prepare it....', 'review_id': 291774694, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052} 2025-03-31 00:32:39 [reviews] INFO: Scraped item: {'review': 'Food was good but very expensive....350 rs for 6 pieces chkn lollypop....it is through the roof!', 'review_id': 291650613, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052} 2025-03-31 00:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34052&page=1> {'review': 'Food was good but very expensive....350 rs for 6 pieces chkn lollypop....it is through the roof!', 'review_id': 291650613, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052} 2025-03-31 00:32:39 [reviews] INFO: Scraped item: {'review': 'Nice', 'review_id': 291647681, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052} 2025-03-31 00:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34052&page=1> {'review': 'Nice', 'review_id': 291647681, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052} 2025-03-31 00:32:39 [reviews] INFO: Scraped item: {'review': 'Amazing food taste was good', 'review_id': 291591410, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052} 2025-03-31 00:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34052&page=1> {'review': 'Amazing food taste was good', 'review_id': 291591410, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052} 2025-03-31 00:32:39 [reviews] INFO: Scraped item: {'review': 'Nicee caramel custard;', 'review_id': 291528133, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052} 2025-03-31 00:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34052&page=1> {'review': 'Nicee caramel custard;', 'review_id': 291528133, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052} 2025-03-31 00:32:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:32:43 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381145, 'download_latency': 0.7016353607177734, 'depth': 0} 2025-03-31 00:32:43 [reviews] INFO: Scraped item: {'review': "services of the restaurant I have gone down I come after very long over here the flavour of the foods have gone of sunglasses a lot of time now it's not the same quality of food that you expect at 5 spice", 'review_id': 291736900, 'rating': '3', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157} 2025-03-31 00:32:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34157&page=1> {'review': "services of the restaurant I have gone down I come after very long over here the flavour of the foods have gone of sunglasses a lot of time now it's not the same quality of food that you expect at 5 spice", 'review_id': 291736900, 'rating': '3', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157} 2025-03-31 00:32:43 [reviews] INFO: Scraped item: {'review': 'dining here after a long time ambience has gone down so has the hygiene food was ok not what I remember it being flavour s were off ', 'review_id': 291735336, 'rating': '3', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157} 2025-03-31 00:32:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34157&page=1> {'review': 'dining here after a long time ambience has gone down so has the hygiene food was ok not what I remember it being flavour s were off ', 'review_id': 291735336, 'rating': '3', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157} 2025-03-31 00:32:43 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291706981, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157} 2025-03-31 00:32:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34157&page=1> {'review': '', 'review_id': 291706981, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157} 2025-03-31 00:32:43 [reviews] INFO: Scraped item: {'review': "no taste it's like just normal fried rice wasted time and money ", 'review_id': 291034387, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157} 2025-03-31 00:32:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34157&page=1> {'review': "no taste it's like just normal fried rice wasted time and money ", 'review_id': 291034387, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157} 2025-03-31 00:32:43 [reviews] INFO: Scraped item: {'review': 'Chicken quantity next to none, only full of omlet', 'review_id': 289980697, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157} 2025-03-31 00:32:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34157&page=1> {'review': 'Chicken quantity next to none, only full of omlet', 'review_id': 289980697, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157} 2025-03-31 00:32:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:32:46 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381145, 'download_latency': 0.7676007747650146, 'depth': 0} 2025-03-31 00:32:46 [reviews] INFO: Scraped item: {'review': 'The biryani was burnt and tasted bitter', 'review_id': 291766002, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269} 2025-03-31 00:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34269&page=1> {'review': 'The biryani was burnt and tasted bitter', 'review_id': 291766002, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269} 2025-03-31 00:32:46 [reviews] INFO: Scraped item: {'review': 'worst test very bad experience ', 'review_id': 291724878, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269} 2025-03-31 00:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34269&page=1> {'review': 'worst test very bad experience ', 'review_id': 291724878, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269} 2025-03-31 00:32:46 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291605963, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269} 2025-03-31 00:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34269&page=1> {'review': '', 'review_id': 291605963, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269} 2025-03-31 00:32:46 [reviews] INFO: Scraped item: {'review': 'lollipop is spoiled ', 'review_id': 291327521, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269} 2025-03-31 00:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34269&page=1> {'review': 'lollipop is spoiled ', 'review_id': 291327521, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269} 2025-03-31 00:32:46 [reviews] INFO: Scraped item: {'review': 'Had ordered brain masala. a) It was white gravy and bland b) There was hardly any brain. just gravy', 'review_id': 291290857, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269} 2025-03-31 00:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34269&page=1> {'review': 'Had ordered brain masala. a) It was white gravy and bland b) There was hardly any brain. just gravy', 'review_id': 291290857, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269} 2025-03-31 00:32:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:32:50 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 0, 'brand_name': 'Kailash Parbat ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 34410, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381145, 'download_latency': 0.8026056289672852, 'depth': 0} 2025-03-31 00:32:50 [reviews] INFO: Scraped item: {'review': "didn't get crockery along with order", 'review_id': 291602322, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 0, 'brand_name': 'Kailash Parbat ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 34410} 2025-03-31 00:32:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34410&page=1> {'review': "didn't get crockery along with order", 'review_id': 291602322, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 0, 'brand_name': 'Kailash Parbat ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 34410} 2025-03-31 00:32:50 [reviews] INFO: Scraped item: {'review': 'dull and dry', 'review_id': 290510883, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 0, 'brand_name': 'Kailash Parbat ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 34410} 2025-03-31 00:32:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34410&page=1> {'review': 'dull and dry', 'review_id': 290510883, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 0, 'brand_name': 'Kailash Parbat ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 34410} 2025-03-31 00:32:50 [reviews] INFO: Scraped item: {'review': 'too good delivers very fast', 'review_id': 289651106, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 0, 'brand_name': 'Kailash Parbat ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 34410} 2025-03-31 00:32:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34410&page=1> {'review': 'too good delivers very fast', 'review_id': 289651106, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 0, 'brand_name': 'Kailash Parbat ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 34410} 2025-03-31 00:32:50 [reviews] INFO: Stopping for res_id: 34410 as reviews are older than 7 days. 2025-03-31 00:32:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-31 00:32:53 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-31 00:32:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:32:54 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381145, 'download_latency': 0.7564487457275391, 'depth': 0} 2025-03-31 00:32:54 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291733524, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777} 2025-03-31 00:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34777&page=1> {'review': '', 'review_id': 291733524, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777} 2025-03-31 00:32:54 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291643699, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777} 2025-03-31 00:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34777&page=1> {'review': '', 'review_id': 291643699, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777} 2025-03-31 00:32:54 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291607248, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777} 2025-03-31 00:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34777&page=1> {'review': '', 'review_id': 291607248, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777} 2025-03-31 00:32:54 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291591959, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777} 2025-03-31 00:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34777&page=1> {'review': '', 'review_id': 291591959, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777} 2025-03-31 00:32:54 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291349651, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777} 2025-03-31 00:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34777&page=1> {'review': '', 'review_id': 291349651, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777} 2025-03-31 00:32:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:32:58 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 73, 'brand_name': 'Fire Bowl', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 34810, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381145, 'download_latency': 0.7779138088226318, 'depth': 0} 2025-03-31 00:32:58 [reviews] INFO: Stopping for res_id: 34810 as reviews are older than 7 days. 2025-03-31 00:33:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:33:01 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381145, 'download_latency': 0.7341969013214111, 'depth': 0} 2025-03-31 00:33:01 [reviews] INFO: Scraped item: {'review': 'Too oily', 'review_id': 291781397, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844} 2025-03-31 00:33:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34844&page=1> {'review': 'Too oily', 'review_id': 291781397, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844} 2025-03-31 00:33:01 [reviews] INFO: Scraped item: {'review': 'Worst value for money too sweet and No good mango tasty shake', 'review_id': 291763646, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844} 2025-03-31 00:33:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34844&page=1> {'review': 'Worst value for money too sweet and No good mango tasty shake', 'review_id': 291763646, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844} 2025-03-31 00:33:01 [reviews] INFO: Scraped item: {'review': 'muje smjh nai aati ki chutney dene mai kya problem hoti hai tumare logo ko ,maine kabab order kiya tha usko bina chutney ke kaise khaate ho ? waha aake khaate hain toj 10 plate chutney ke rakhte ho table pe,ghar pe manwate hain toh tumari jaan nikal jaati hai zara si chutney dene mai ,really pathetic', 'review_id': 291574171, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844} 2025-03-31 00:33:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34844&page=1> {'review': 'muje smjh nai aati ki chutney dene mai kya problem hoti hai tumare logo ko ,maine kabab order kiya tha usko bina chutney ke kaise khaate ho ? waha aake khaate hain toj 10 plate chutney ke rakhte ho table pe,ghar pe manwate hain toh tumari jaan nikal jaati hai zara si chutney dene mai ,really pathetic', 'review_id': 291574171, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844} 2025-03-31 00:33:01 [reviews] INFO: Scraped item: {'review': "This must be the worlds tastiest but also smallest shawarma. If you are really hungry order 3 pieces right away coz one won't fulfill your belly ::)", 'review_id': 291327405, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844} 2025-03-31 00:33:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34844&page=1> {'review': "This must be the worlds tastiest but also smallest shawarma. If you are really hungry order 3 pieces right away coz one won't fulfill your belly ::)", 'review_id': 291327405, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844} 2025-03-31 00:33:01 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291296140, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844} 2025-03-31 00:33:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34844&page=1> {'review': '', 'review_id': 291296140, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844} 2025-03-31 00:33:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:33:05 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 80, 'brand_name': 'Mainland China', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 35232, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381145, 'download_latency': 0.7736096382141113, 'depth': 0} 2025-03-31 00:33:05 [reviews] INFO: Scraped item: {'review': 'Less Quantity', 'review_id': 291667961, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 80, 'brand_name': 'Mainland China', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 35232} 2025-03-31 00:33:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=35232&page=1> {'review': 'Less Quantity', 'review_id': 291667961, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 80, 'brand_name': 'Mainland China', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 35232} 2025-03-31 00:33:05 [reviews] INFO: Stopping for res_id: 35232 as reviews are older than 7 days. 2025-03-31 00:33:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-31 00:33:08 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-31 00:33:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:33:10 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 0, 'brand_name': 'New yorker', 'city': 'Mumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 36164, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381145, 'download_latency': 1.6656198501586914, 'depth': 0} 2025-03-31 00:33:10 [reviews] INFO: Stopping for res_id: 36164 as reviews are older than 7 days. 2025-03-31 00:33:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:33:12 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 61, 'brand_name': "Mom's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 36226, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381145, 'download_latency': 0.755133867263794, 'depth': 0} 2025-03-31 00:33:12 [reviews] INFO: Scraped item: {'review': 'Nice taste and and good quality and quantity', 'review_id': 291407444, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 61, 'brand_name': "Mom's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 36226} 2025-03-31 00:33:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36226&page=1> {'review': 'Nice taste and and good quality and quantity', 'review_id': 291407444, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 61, 'brand_name': "Mom's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 36226} 2025-03-31 00:33:12 [reviews] INFO: Scraped item: {'review': 'not good ', 'review_id': 291040289, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 61, 'brand_name': "Mom's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 36226} 2025-03-31 00:33:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36226&page=1> {'review': 'not good ', 'review_id': 291040289, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 61, 'brand_name': "Mom's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 36226} 2025-03-31 00:33:12 [reviews] INFO: Scraped item: {'review': "chicken leg undercooked and not upto the mark like always. it's stale", 'review_id': 289999830, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 61, 'brand_name': "Mom's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 36226} 2025-03-31 00:33:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36226&page=1> {'review': "chicken leg undercooked and not upto the mark like always. it's stale", 'review_id': 289999830, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 61, 'brand_name': "Mom's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 36226} 2025-03-31 00:33:12 [reviews] INFO: Stopping for res_id: 36226 as reviews are older than 7 days. 2025-03-31 00:33:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:33:15 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381145, 'download_latency': 0.7069084644317627, 'depth': 0} 2025-03-31 00:33:15 [reviews] INFO: Scraped item: {'review': 'very bad food.
quality has significantly deteriorated. also music is too loud very noisy place. should be avoided.', 'review_id': 291327328, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291} 2025-03-31 00:33:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36291&page=1> {'review': 'very bad food.
quality has significantly deteriorated. also music is too loud very noisy place. should be avoided.', 'review_id': 291327328, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291} 2025-03-31 00:33:15 [reviews] INFO: Scraped item: {'review': 'Superb food!', 'review_id': 291284708, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291} 2025-03-31 00:33:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36291&page=1> {'review': 'Superb food!', 'review_id': 291284708, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291} 2025-03-31 00:33:15 [reviews] INFO: Scraped item: {'review': 'Hummus is very liquid. Pastry got crumbled as packing was not done properly', 'review_id': 291188778, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291} 2025-03-31 00:33:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36291&page=1> {'review': 'Hummus is very liquid. Pastry got crumbled as packing was not done properly', 'review_id': 291188778, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291} 2025-03-31 00:33:16 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290171807, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291} 2025-03-31 00:33:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36291&page=1> {'review': '', 'review_id': 290171807, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291} 2025-03-31 00:33:16 [reviews] INFO: Stopping for res_id: 36291 as reviews are older than 7 days. 2025-03-31 00:33:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:33:20 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 79, 'brand_name': 'China Gate', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 36299, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381145, 'download_latency': 0.8166530132293701, 'depth': 0} 2025-03-31 00:33:20 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291591114, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 79, 'brand_name': 'China Gate', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 36299} 2025-03-31 00:33:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36299&page=1> {'review': '', 'review_id': 291591114, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 79, 'brand_name': 'China Gate', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 36299} 2025-03-31 00:33:20 [reviews] INFO: Scraped item: {'review': 'too oily ', 'review_id': 291505099, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 79, 'brand_name': 'China Gate', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 36299} 2025-03-31 00:33:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36299&page=1> {'review': 'too oily ', 'review_id': 291505099, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 79, 'brand_name': 'China Gate', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 36299} 2025-03-31 00:33:20 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291241518, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 79, 'brand_name': 'China Gate', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 36299} 2025-03-31 00:33:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36299&page=1> {'review': '', 'review_id': 291241518, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 79, 'brand_name': 'China Gate', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 36299} 2025-03-31 00:33:20 [reviews] INFO: Stopping for res_id: 36299 as reviews are older than 7 days. 2025-03-31 00:33:22 [scrapy.extensions.logstats] INFO: Crawled 16 pages (at 16 pages/min), scraped 54 items (at 54 items/min) 2025-03-31 00:33:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:33:23 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 90, 'brand_name': 'Say Cheese', 'city': 'Mumbai', 'sub_zone': 'Charni Road', 'platform': 'zomato', 'res_id': 36983, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381147, 'download_latency': 0.7666776180267334, 'depth': 0} 2025-03-31 00:33:23 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291747153, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 90, 'brand_name': 'Say Cheese', 'city': 'Mumbai', 'sub_zone': 'Charni Road', 'platform': 'zomato', 'res_id': 36983} 2025-03-31 00:33:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36983&page=1> {'review': '', 'review_id': 291747153, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 90, 'brand_name': 'Say Cheese', 'city': 'Mumbai', 'sub_zone': 'Charni Road', 'platform': 'zomato', 'res_id': 36983} 2025-03-31 00:33:23 [reviews] INFO: Scraped item: {'review': 'ordered 2 sushi servings, received only one. ', 'review_id': 291734250, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 90, 'brand_name': 'Say Cheese', 'city': 'Mumbai', 'sub_zone': 'Charni Road', 'platform': 'zomato', 'res_id': 36983} 2025-03-31 00:33:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36983&page=1> {'review': 'ordered 2 sushi servings, received only one. ', 'review_id': 291734250, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 90, 'brand_name': 'Say Cheese', 'city': 'Mumbai', 'sub_zone': 'Charni Road', 'platform': 'zomato', 'res_id': 36983} 2025-03-31 00:33:23 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291410412, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 90, 'brand_name': 'Say Cheese', 'city': 'Mumbai', 'sub_zone': 'Charni Road', 'platform': 'zomato', 'res_id': 36983} 2025-03-31 00:33:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36983&page=1> {'review': '', 'review_id': 291410412, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 90, 'brand_name': 'Say Cheese', 'city': 'Mumbai', 'sub_zone': 'Charni Road', 'platform': 'zomato', 'res_id': 36983} 2025-03-31 00:33:23 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291380954, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 90, 'brand_name': 'Say Cheese', 'city': 'Mumbai', 'sub_zone': 'Charni Road', 'platform': 'zomato', 'res_id': 36983} 2025-03-31 00:33:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36983&page=1> {'review': '', 'review_id': 291380954, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 90, 'brand_name': 'Say Cheese', 'city': 'Mumbai', 'sub_zone': 'Charni Road', 'platform': 'zomato', 'res_id': 36983} 2025-03-31 00:33:23 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291375264, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 90, 'brand_name': 'Say Cheese', 'city': 'Mumbai', 'sub_zone': 'Charni Road', 'platform': 'zomato', 'res_id': 36983} 2025-03-31 00:33:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36983&page=1> {'review': '', 'review_id': 291375264, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 90, 'brand_name': 'Say Cheese', 'city': 'Mumbai', 'sub_zone': 'Charni Road', 'platform': 'zomato', 'res_id': 36983} 2025-03-31 00:33:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-31 00:33:23 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-31 00:33:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:33:27 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 9, 'brand_name': 'Status', 'city': 'Mumbai', 'sub_zone': 'Nariman Point', 'platform': 'zomato', 'res_id': 37459, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381149, 'download_latency': 0.7786753177642822, 'depth': 0} 2025-03-31 00:33:27 [reviews] INFO: Scraped item: {'review': 'Food was of worst quality', 'review_id': 290671559, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 9, 'brand_name': 'Status', 'city': 'Mumbai', 'sub_zone': 'Nariman Point', 'platform': 'zomato', 'res_id': 37459} 2025-03-31 00:33:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37459&page=1> {'review': 'Food was of worst quality', 'review_id': 290671559, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 9, 'brand_name': 'Status', 'city': 'Mumbai', 'sub_zone': 'Nariman Point', 'platform': 'zomato', 'res_id': 37459} 2025-03-31 00:33:27 [reviews] INFO: Scraped item: {'review': 'The corn on toast is tasty sour', 'review_id': 290447400, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 9, 'brand_name': 'Status', 'city': 'Mumbai', 'sub_zone': 'Nariman Point', 'platform': 'zomato', 'res_id': 37459} 2025-03-31 00:33:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37459&page=1> {'review': 'The corn on toast is tasty sour', 'review_id': 290447400, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 9, 'brand_name': 'Status', 'city': 'Mumbai', 'sub_zone': 'Nariman Point', 'platform': 'zomato', 'res_id': 37459} 2025-03-31 00:33:27 [reviews] INFO: Stopping for res_id: 37459 as reviews are older than 7 days. 2025-03-31 00:33:31 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:33:34 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:33:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-31 00:33:38 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-31 00:33:39 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:33:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:33:47 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:33:51 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:33:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-31 00:33:53 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-31 00:33:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:33:54 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381175, 'download_latency': 0.7062532901763916, 'depth': 0} 2025-03-31 00:33:54 [reviews] INFO: Scraped item: {'review': 'Food is delicious', 'review_id': 291674000, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679} 2025-03-31 00:33:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37679&page=1> {'review': 'Food is delicious', 'review_id': 291674000, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679} 2025-03-31 00:33:54 [reviews] INFO: Scraped item: {'review': 'The rajma chawal bowl is fantastic in taste but the quantity of rajma is less compared to the rice. More rajma would make it perfect. ', 'review_id': 291666812, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679} 2025-03-31 00:33:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37679&page=1> {'review': 'The rajma chawal bowl is fantastic in taste but the quantity of rajma is less compared to the rice. More rajma would make it perfect. ', 'review_id': 291666812, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679} 2025-03-31 00:33:54 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291572716, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679} 2025-03-31 00:33:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37679&page=1> {'review': '', 'review_id': 291572716, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679} 2025-03-31 00:33:54 [reviews] INFO: Scraped item: {'review': 'Amazing service by Satyandra Negiji', 'review_id': 291543676, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679} 2025-03-31 00:33:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37679&page=1> {'review': 'Amazing service by Satyandra Negiji', 'review_id': 291543676, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679} 2025-03-31 00:33:54 [reviews] INFO: Scraped item: {'review': 'Good food & Service is awesome ', 'review_id': 291528484, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679} 2025-03-31 00:33:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37679&page=1> {'review': 'Good food & Service is awesome ', 'review_id': 291528484, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679} 2025-03-31 00:33:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:34:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:34:01 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381181, 'download_latency': 0.7256214618682861, 'depth': 0} 2025-03-31 00:34:01 [reviews] INFO: Scraped item: {'review': 'death by chocolate cake was sour .not fresh at all', 'review_id': 291662154, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823} 2025-03-31 00:34:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37823&page=1> {'review': 'death by chocolate cake was sour .not fresh at all', 'review_id': 291662154, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823} 2025-03-31 00:34:01 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291427368, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823} 2025-03-31 00:34:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37823&page=1> {'review': '', 'review_id': 291427368, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823} 2025-03-31 00:34:01 [reviews] INFO: Scraped item: {'review': 'Delivery very late', 'review_id': 291381819, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823} 2025-03-31 00:34:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37823&page=1> {'review': 'Delivery very late', 'review_id': 291381819, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823} 2025-03-31 00:34:01 [reviews] INFO: Scraped item: {'review': "very greasy and the chicken pieces in the fried rice were not fresh, it had weird black color fleshy like things which didn't look like chicken had to throw it away all", 'review_id': 291336214, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823} 2025-03-31 00:34:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37823&page=1> {'review': "very greasy and the chicken pieces in the fried rice were not fresh, it had weird black color fleshy like things which didn't look like chicken had to throw it away all", 'review_id': 291336214, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823} 2025-03-31 00:34:01 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291104712, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823} 2025-03-31 00:34:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37823&page=1> {'review': '', 'review_id': 291104712, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823} 2025-03-31 00:34:04 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:34:08 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:34:08 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 97, 'brand_name': 'Jai Hind Lunch Home', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 37896, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381191, 'download_latency': 1.0482821464538574, 'depth': 0} 2025-03-31 00:34:08 [reviews] INFO: Scraped item: {'review': '', 'review_id': 289957720, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 97, 'brand_name': 'Jai Hind Lunch Home', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 37896} 2025-03-31 00:34:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37896&page=1> {'review': '', 'review_id': 289957720, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 97, 'brand_name': 'Jai Hind Lunch Home', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 37896} 2025-03-31 00:34:08 [reviews] INFO: Stopping for res_id: 37896 as reviews are older than 7 days. 2025-03-31 00:34:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-31 00:34:08 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-31 00:34:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:34:11 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 0, 'brand_name': 'Relish', 'city': 'Mumbai', 'sub_zone': 'Churchgate', 'platform': 'zomato', 'res_id': 37978, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381192, 'download_latency': 0.7370679378509521, 'depth': 0} 2025-03-31 00:34:11 [reviews] INFO: Scraped item: {'review': 'We had a bill of 1402 they give us 50rs note and 48rs coin in other restaurants they are like 2rs so they let it be or they ask that do you have 2rs change but in relish they didnโ€™t ask me n they give us 48rs all coins', 'review_id': 289606483, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-25', 'competitor_id': 0, 'brand_name': 'Relish', 'city': 'Mumbai', 'sub_zone': 'Churchgate', 'platform': 'zomato', 'res_id': 37978} 2025-03-31 00:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37978&page=1> {'review': 'We had a bill of 1402 they give us 50rs note and 48rs coin in other restaurants they are like 2rs so they let it be or they ask that do you have 2rs change but in relish they didnโ€™t ask me n they give us 48rs all coins', 'review_id': 289606483, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-25', 'competitor_id': 0, 'brand_name': 'Relish', 'city': 'Mumbai', 'sub_zone': 'Churchgate', 'platform': 'zomato', 'res_id': 37978} 2025-03-31 00:34:11 [reviews] INFO: Stopping for res_id: 37978 as reviews are older than 7 days. 2025-03-31 00:34:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:34:14 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 64, 'brand_name': "Jim - Me's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Hill Road ', 'platform': 'zomato', 'res_id': 38512, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381196, 'download_latency': 0.767383337020874, 'depth': 0} 2025-03-31 00:34:14 [reviews] INFO: Scraped item: {'review': 'great taste ', 'review_id': 291492748, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 64, 'brand_name': "Jim - Me's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Hill Road ', 'platform': 'zomato', 'res_id': 38512} 2025-03-31 00:34:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=38512&page=1> {'review': 'great taste ', 'review_id': 291492748, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 64, 'brand_name': "Jim - Me's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Hill Road ', 'platform': 'zomato', 'res_id': 38512} 2025-03-31 00:34:14 [reviews] INFO: Stopping for res_id: 38512 as reviews are older than 7 days. 2025-03-31 00:34:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:34:19 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 69, 'brand_name': 'Asian Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 38797, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381200, 'download_latency': 0.8297412395477295, 'depth': 0} 2025-03-31 00:34:19 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290304091, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 69, 'brand_name': 'Asian Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 38797} 2025-03-31 00:34:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=38797&page=1> {'review': '', 'review_id': 290304091, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 69, 'brand_name': 'Asian Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 38797} 2025-03-31 00:34:19 [reviews] INFO: Stopping for res_id: 38797 as reviews are older than 7 days. 2025-03-31 00:34:22 [scrapy.extensions.logstats] INFO: Crawled 24 pages (at 8 pages/min), scraped 75 items (at 21 items/min) 2025-03-31 00:34:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:34:23 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'PHOENIX', 'platform': 'zomato', 'res_id': 39528, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381203, 'download_latency': 0.6901514530181885, 'depth': 0} 2025-03-31 00:34:23 [reviews] INFO: Stopping for res_id: 39528 as reviews are older than 7 days. 2025-03-31 00:34:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-31 00:34:23 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-31 00:34:26 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:34:29 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:34:33 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:34:37 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:34:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:34:43 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:34:47 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:34:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:34:50 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 39, 'brand_name': 'Yauatcha', 'city': 'Mumbai', 'sub_zone': 'Bandra Kurla Complex', 'platform': 'zomato', 'res_id': 39675, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381235, 'download_latency': 0.6998536586761475, 'depth': 0} 2025-03-31 00:34:50 [reviews] INFO: Scraped item: {'review': 'dilevery boy nice man', 'review_id': 290160236, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 39, 'brand_name': 'Yauatcha', 'city': 'Mumbai', 'sub_zone': 'Bandra Kurla Complex', 'platform': 'zomato', 'res_id': 39675} 2025-03-31 00:34:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=39675&page=1> {'review': 'dilevery boy nice man', 'review_id': 290160236, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 39, 'brand_name': 'Yauatcha', 'city': 'Mumbai', 'sub_zone': 'Bandra Kurla Complex', 'platform': 'zomato', 'res_id': 39675} 2025-03-31 00:34:50 [reviews] INFO: Stopping for res_id: 39675 as reviews are older than 7 days. 2025-03-31 00:34:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-31 00:34:53 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-31 00:34:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:34:56 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:35:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:35:03 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:35:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:35:07 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381252, 'download_latency': 0.698232889175415, 'depth': 0} 2025-03-31 00:35:07 [reviews] INFO: Scraped item: {'review': 'fried noodles k liye maine kitni time extra pay kiya hai lekin jyada tar wo bhejte nhi hai ', 'review_id': 291483627, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083} 2025-03-31 00:35:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=40083&page=1> {'review': 'fried noodles k liye maine kitni time extra pay kiya hai lekin jyada tar wo bhejte nhi hai ', 'review_id': 291483627, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083} 2025-03-31 00:35:07 [reviews] INFO: Scraped item: {'review': 'Very bad, oily, plus felt stale the gravy', 'review_id': 291441554, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083} 2025-03-31 00:35:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=40083&page=1> {'review': 'Very bad, oily, plus felt stale the gravy', 'review_id': 291441554, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083} 2025-03-31 00:35:07 [reviews] INFO: Scraped item: {'review': 'very bad taste
bhut hi bura banaya tha aapne triple
there is no chicken in rice,
no Schezwan in there,
very bad experience ', 'review_id': 289832993, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083} 2025-03-31 00:35:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=40083&page=1> {'review': 'very bad taste
bhut hi bura banaya tha aapne triple
there is no chicken in rice,
no Schezwan in there,
very bad experience ', 'review_id': 289832993, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083} 2025-03-31 00:35:07 [reviews] INFO: Stopping for res_id: 40083 as reviews are older than 7 days. 2025-03-31 00:35:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:35:10 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381255, 'download_latency': 0.7609074115753174, 'depth': 0} 2025-03-31 00:35:10 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291770528, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143} 2025-03-31 00:35:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=41143&page=1> {'review': '', 'review_id': 291770528, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143} 2025-03-31 00:35:10 [reviews] INFO: Scraped item: {'review': "even after giving request for fried noodles they didn't send", 'review_id': 291763143, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143} 2025-03-31 00:35:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=41143&page=1> {'review': "even after giving request for fried noodles they didn't send", 'review_id': 291763143, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143} 2025-03-31 00:35:10 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291604681, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143} 2025-03-31 00:35:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=41143&page=1> {'review': '', 'review_id': 291604681, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143} 2025-03-31 00:35:10 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291380268, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143} 2025-03-31 00:35:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=41143&page=1> {'review': '', 'review_id': 291380268, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143} 2025-03-31 00:35:10 [reviews] INFO: Scraped item: {'review': 'the washroom is very dirty.
food served gets cold in 2 minutes.', 'review_id': 291362898, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143} 2025-03-31 00:35:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=41143&page=1> {'review': 'the washroom is very dirty.
food served gets cold in 2 minutes.', 'review_id': 291362898, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143} 2025-03-31 00:35:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:35:13 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 63, 'brand_name': 'Cocoon- Dragonfly Hotel', 'city': 'Mumbai', 'sub_zone': 'Chakala', 'platform': 'zomato', 'res_id': 42630, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381259, 'download_latency': 0.9399363994598389, 'depth': 0} 2025-03-31 00:35:13 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290260007, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 63, 'brand_name': 'Cocoon- Dragonfly Hotel', 'city': 'Mumbai', 'sub_zone': 'Chakala', 'platform': 'zomato', 'res_id': 42630} 2025-03-31 00:35:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=42630&page=1> {'review': '', 'review_id': 290260007, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 63, 'brand_name': 'Cocoon- Dragonfly Hotel', 'city': 'Mumbai', 'sub_zone': 'Chakala', 'platform': 'zomato', 'res_id': 42630} 2025-03-31 00:35:13 [reviews] INFO: Scraped item: {'review': "it wasn't tasty", 'review_id': 289632377, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 63, 'brand_name': 'Cocoon- Dragonfly Hotel', 'city': 'Mumbai', 'sub_zone': 'Chakala', 'platform': 'zomato', 'res_id': 42630} 2025-03-31 00:35:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=42630&page=1> {'review': "it wasn't tasty", 'review_id': 289632377, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 63, 'brand_name': 'Cocoon- Dragonfly Hotel', 'city': 'Mumbai', 'sub_zone': 'Chakala', 'platform': 'zomato', 'res_id': 42630} 2025-03-31 00:35:13 [reviews] INFO: Stopping for res_id: 42630 as reviews are older than 7 days. 2025-03-31 00:35:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:35:16 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 66, 'brand_name': 'Red Chilli', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 42695, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381263, 'download_latency': 0.7679524421691895, 'depth': 0} 2025-03-31 00:35:16 [reviews] INFO: Scraped item: {'review': 'Very nice chef', 'review_id': 290379931, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 66, 'brand_name': 'Red Chilli', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 42695} 2025-03-31 00:35:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=42695&page=1> {'review': 'Very nice chef', 'review_id': 290379931, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 66, 'brand_name': 'Red Chilli', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 42695} 2025-03-31 00:35:16 [reviews] INFO: Stopping for res_id: 42695 as reviews are older than 7 days. 2025-03-31 00:35:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:35:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:35:22 [scrapy.extensions.logstats] INFO: Crawled 30 pages (at 6 pages/min), scraped 87 items (at 12 items/min) 2025-03-31 00:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-31 00:35:23 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-31 00:35:26 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:35:30 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:35:33 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:35:38 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:35:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:35:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:35:45 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 85, 'brand_name': 'H Paramesha Fast Food Corner', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 43905, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381290, 'download_latency': 0.9304559230804443, 'depth': 0} 2025-03-31 00:35:45 [reviews] INFO: Stopping for res_id: 43905 as reviews are older than 7 days. 2025-03-31 00:35:48 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:35:52 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-31 00:35:53 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-31 00:35:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:36:01 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:36:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:36:05 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'RCITY', 'platform': 'zomato', 'res_id': 43965, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381308, 'download_latency': 0.662531852722168, 'depth': 0} 2025-03-31 00:36:05 [reviews] INFO: Scraped item: {'review': 'Loved the chole bature and nachos', 'review_id': 291715496, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'RCITY', 'platform': 'zomato', 'res_id': 43965} 2025-03-31 00:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=43965&page=1> {'review': 'Loved the chole bature and nachos', 'review_id': 291715496, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'RCITY', 'platform': 'zomato', 'res_id': 43965} 2025-03-31 00:36:05 [reviews] INFO: Scraped item: {'review': 'Great food', 'review_id': 291694651, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'RCITY', 'platform': 'zomato', 'res_id': 43965} 2025-03-31 00:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=43965&page=1> {'review': 'Great food', 'review_id': 291694651, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'RCITY', 'platform': 'zomato', 'res_id': 43965} 2025-03-31 00:36:05 [reviews] INFO: Scraped item: {'review': 'Best place for veg foodโ€ฆ ! Amazing taste. Very polite staff', 'review_id': 291691002, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'RCITY', 'platform': 'zomato', 'res_id': 43965} 2025-03-31 00:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=43965&page=1> {'review': 'Best place for veg foodโ€ฆ ! Amazing taste. Very polite staff', 'review_id': 291691002, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'RCITY', 'platform': 'zomato', 'res_id': 43965} 2025-03-31 00:36:05 [reviews] INFO: Scraped item: {'review': 'All good', 'review_id': 291687105, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'RCITY', 'platform': 'zomato', 'res_id': 43965} 2025-03-31 00:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=43965&page=1> {'review': 'All good', 'review_id': 291687105, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'RCITY', 'platform': 'zomato', 'res_id': 43965} 2025-03-31 00:36:05 [reviews] INFO: Scraped item: {'review': 'Great Food', 'review_id': 291620321, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'RCITY', 'platform': 'zomato', 'res_id': 43965} 2025-03-31 00:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=43965&page=1> {'review': 'Great Food', 'review_id': 291620321, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'RCITY', 'platform': 'zomato', 'res_id': 43965} 2025-03-31 00:36:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:36:10 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381310, 'download_latency': 0.6656606197357178, 'depth': 0} 2025-03-31 00:36:10 [reviews] INFO: Scraped item: {'review': 'Good food, good ambience, Shashikant was our server', 'review_id': 291742987, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672} 2025-03-31 00:36:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=46672&page=1> {'review': 'Good food, good ambience, Shashikant was our server', 'review_id': 291742987, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672} 2025-03-31 00:36:10 [reviews] INFO: Scraped item: {'review': 'amazing experience with food quality.
Mr. Dilip has suggested delicious food to have for and we enjoyed the taste', 'review_id': 291733842, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672} 2025-03-31 00:36:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=46672&page=1> {'review': 'amazing experience with food quality.
Mr. Dilip has suggested delicious food to have for and we enjoyed the taste', 'review_id': 291733842, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672} 2025-03-31 00:36:10 [reviews] INFO: Scraped item: {'review': 'AMAZING FOOD DELIGHTFUL SERVICE VERY HELPSUL STAFF ', 'review_id': 291723552, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672} 2025-03-31 00:36:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=46672&page=1> {'review': 'AMAZING FOOD DELIGHTFUL SERVICE VERY HELPSUL STAFF ', 'review_id': 291723552, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672} 2025-03-31 00:36:10 [reviews] INFO: Scraped item: {'review': 'Anoop Yadav took great care of us. food was amazing and great service', 'review_id': 291718453, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672} 2025-03-31 00:36:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=46672&page=1> {'review': 'Anoop Yadav took great care of us. food was amazing and great service', 'review_id': 291718453, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672} 2025-03-31 00:36:10 [reviews] INFO: Scraped item: {'review': 'Hemal Mistry ', 'review_id': 291700785, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672} 2025-03-31 00:36:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=46672&page=1> {'review': 'Hemal Mistry ', 'review_id': 291700785, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672} 2025-03-31 00:36:13 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:36:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:36:16 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 26, 'brand_name': 'Starbucks Coffee', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 47111, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381317, 'download_latency': 0.7625846862792969, 'depth': 0} 2025-03-31 00:36:16 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290497652, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 26, 'brand_name': 'Starbucks Coffee', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 47111} 2025-03-31 00:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47111&page=1> {'review': '', 'review_id': 290497652, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 26, 'brand_name': 'Starbucks Coffee', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 47111} 2025-03-31 00:36:16 [reviews] INFO: Scraped item: {'review': 'they didnt follow additional instruction, lif was also not proper, no straw', 'review_id': 289761506, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 26, 'brand_name': 'Starbucks Coffee', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 47111} 2025-03-31 00:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47111&page=1> {'review': 'they didnt follow additional instruction, lif was also not proper, no straw', 'review_id': 289761506, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 26, 'brand_name': 'Starbucks Coffee', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 47111} 2025-03-31 00:36:16 [reviews] INFO: Stopping for res_id: 47111 as reviews are older than 7 days. 2025-03-31 00:36:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:36:22 [scrapy.extensions.logstats] INFO: Crawled 34 pages (at 4 pages/min), scraped 99 items (at 12 items/min) 2025-03-31 00:36:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-31 00:36:23 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-31 00:36:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:36:26 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:36:30 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:36:33 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:36:37 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:36:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:36:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:36:46 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381346, 'download_latency': 0.8850486278533936, 'depth': 0} 2025-03-31 00:36:46 [reviews] INFO: Scraped item: {'review': 'terrible food', 'review_id': 291006203, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171} 2025-03-31 00:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47171&page=1> {'review': 'terrible food', 'review_id': 291006203, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171} 2025-03-31 00:36:46 [reviews] INFO: Scraped item: {'review': 'terrible food ', 'review_id': 291004991, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171} 2025-03-31 00:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47171&page=1> {'review': 'terrible food ', 'review_id': 291004991, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171} 2025-03-31 00:36:46 [reviews] INFO: Stopping for res_id: 47171 as reviews are older than 7 days. 2025-03-31 00:36:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:36:52 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:36:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-31 00:36:53 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-31 00:36:55 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:36:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:37:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:37:03 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381366, 'download_latency': 0.7084100246429443, 'depth': 0} 2025-03-31 00:37:03 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291779958, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458} 2025-03-31 00:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47458&page=1> {'review': '', 'review_id': 291779958, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458} 2025-03-31 00:37:03 [reviews] INFO: Scraped item: {'review': 'good', 'review_id': 291731935, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458} 2025-03-31 00:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47458&page=1> {'review': 'good', 'review_id': 291731935, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458} 2025-03-31 00:37:03 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291628963, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458} 2025-03-31 00:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47458&page=1> {'review': '', 'review_id': 291628963, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458} 2025-03-31 00:37:03 [reviews] INFO: Scraped item: {'review': 'Malpu with Rabri was worst , Rabri was is like water malpu was not at all sweet in taste', 'review_id': 291441241, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458} 2025-03-31 00:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47458&page=1> {'review': 'Malpu with Rabri was worst , Rabri was is like water malpu was not at all sweet in taste', 'review_id': 291441241, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458} 2025-03-31 00:37:03 [reviews] INFO: Scraped item: {'review': 'food is not good ', 'review_id': 291415099, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458} 2025-03-31 00:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47458&page=1> {'review': 'food is not good ', 'review_id': 291415099, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458} 2025-03-31 00:37:05 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:37:09 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:37:13 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:37:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:37:19 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:37:22 [scrapy.extensions.logstats] INFO: Crawled 36 pages (at 2 pages/min), scraped 106 items (at 7 items/min) 2025-03-31 00:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-31 00:37:23 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-31 00:37:23 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:37:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:37:31 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:37:35 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:37:39 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:37:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:37:44 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Matunga East', 'platform': 'zomato', 'res_id': 48066, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381407, 'download_latency': 0.8497896194458008, 'depth': 0} 2025-03-31 00:37:44 [reviews] ERROR: Unrecognized relative_date format: nov 18, 2022 2025-03-31 00:37:44 [reviews] INFO: Stopping for res_id: 48066 due to unrecognized date format: Nov 18, 2022. 2025-03-31 00:37:45 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:37:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:37:52 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:37:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-31 00:37:53 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-31 00:37:56 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:38:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:38:00 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381423, 'download_latency': 0.7309095859527588, 'depth': 0} 2025-03-31 00:38:00 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291636133, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323} 2025-03-31 00:38:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=48323&page=1> {'review': '', 'review_id': 291636133, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323} 2025-03-31 00:38:00 [reviews] INFO: Scraped item: {'review': 'Taste was not upto mark', 'review_id': 291565771, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323} 2025-03-31 00:38:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=48323&page=1> {'review': 'Taste was not upto mark', 'review_id': 291565771, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323} 2025-03-31 00:38:00 [reviews] INFO: Scraped item: {'review': 'Food was very disappointing. V paid extra for it to be delivered from Marol Naka outlet but the food was not good at all. Very ordinary. N inspite of asking for cutlery they provided none. ', 'review_id': 291537881, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323} 2025-03-31 00:38:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=48323&page=1> {'review': 'Food was very disappointing. V paid extra for it to be delivered from Marol Naka outlet but the food was not good at all. Very ordinary. N inspite of asking for cutlery they provided none. ', 'review_id': 291537881, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323} 2025-03-31 00:38:00 [reviews] INFO: Scraped item: {'review': 'It stated mutton biryani but it was lamb mutton please mention proper caption . Worst biryani', 'review_id': 291422616, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323} 2025-03-31 00:38:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=48323&page=1> {'review': 'It stated mutton biryani but it was lamb mutton please mention proper caption . Worst biryani', 'review_id': 291422616, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323} 2025-03-31 00:38:00 [reviews] INFO: Scraped item: {'review': "It's quite sad that onions are not provided with the kebabs which is a norm. I ordered extra onions which seemed like yesterday's. Such reputed restaurant should not stoop so low in quality ", 'review_id': 291356682, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323} 2025-03-31 00:38:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=48323&page=1> {'review': "It's quite sad that onions are not provided with the kebabs which is a norm. I ordered extra onions which seemed like yesterday's. Such reputed restaurant should not stoop so low in quality ", 'review_id': 291356682, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323} 2025-03-31 00:38:04 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:38:06 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:38:10 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:38:13 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:38:17 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:38:21 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:38:22 [scrapy.extensions.logstats] INFO: Crawled 38 pages (at 2 pages/min), scraped 111 items (at 5 items/min) 2025-03-31 00:38:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-31 00:38:23 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-31 00:38:25 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:38:28 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:38:32 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:38:37 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:38:39 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:38:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:38:47 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:38:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:38:53 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:38:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-31 00:38:53 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-31 00:38:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:38:59 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 70, 'brand_name': 'Wok Hei', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 48693, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381480, 'download_latency': 2.528594970703125, 'depth': 0} 2025-03-31 00:38:59 [reviews] INFO: Scraped item: {'review': 'I am sorry to say but there was no taste at all in the rice , it felt like steam rice. no burnt garlic, less chicken, no spring onions. it was a big disappointment. ', 'review_id': 291341650, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 70, 'brand_name': 'Wok Hei', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 48693} 2025-03-31 00:38:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=48693&page=1> {'review': 'I am sorry to say but there was no taste at all in the rice , it felt like steam rice. no burnt garlic, less chicken, no spring onions. it was a big disappointment. ', 'review_id': 291341650, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 70, 'brand_name': 'Wok Hei', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 48693} 2025-03-31 00:38:59 [reviews] INFO: Stopping for res_id: 48693 as reviews are older than 7 days. 2025-03-31 00:39:01 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:39:04 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:39:08 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:39:12 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:39:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:39:20 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:39:22 [scrapy.extensions.logstats] INFO: Crawled 39 pages (at 1 pages/min), scraped 112 items (at 1 items/min) 2025-03-31 00:39:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-31 00:39:23 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-31 00:39:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:39:24 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381505, 'download_latency': 0.9032199382781982, 'depth': 0} 2025-03-31 00:39:24 [reviews] INFO: Scraped item: {'review': 'food was cold, not properly packed', 'review_id': 290870463, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608} 2025-03-31 00:39:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=49608&page=1> {'review': 'food was cold, not properly packed', 'review_id': 290870463, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608} 2025-03-31 00:39:24 [reviews] INFO: Scraped item: {'review': 'It had too much Cabbage and it was not very well cooked.', 'review_id': 290840163, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608} 2025-03-31 00:39:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=49608&page=1> {'review': 'It had too much Cabbage and it was not very well cooked.', 'review_id': 290840163, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608} 2025-03-31 00:39:24 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290661404, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608} 2025-03-31 00:39:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=49608&page=1> {'review': '', 'review_id': 290661404, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608} 2025-03-31 00:39:24 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290593437, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608} 2025-03-31 00:39:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=49608&page=1> {'review': '', 'review_id': 290593437, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608} 2025-03-31 00:39:24 [reviews] INFO: Scraped item: {'review': 'Malaysian flat noddles had become too dry', 'review_id': 290383328, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608} 2025-03-31 00:39:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=49608&page=1> {'review': 'Malaysian flat noddles had become too dry', 'review_id': 290383328, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608} 2025-03-31 00:39:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:39:29 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 95, 'brand_name': 'Mad Over Donuts', 'city': 'Bangalore', 'sub_zone': 'Brigade Road', 'platform': 'zomato', 'res_id': 54400, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381509, 'download_latency': 1.182770013809204, 'depth': 0} 2025-03-31 00:39:29 [reviews] INFO: Scraped item: {'review': "I got two dn's @ 121 best.", 'review_id': 290037614, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 95, 'brand_name': 'Mad Over Donuts', 'city': 'Bangalore', 'sub_zone': 'Brigade Road', 'platform': 'zomato', 'res_id': 54400} 2025-03-31 00:39:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=54400&page=1> {'review': "I got two dn's @ 121 best.", 'review_id': 290037614, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 95, 'brand_name': 'Mad Over Donuts', 'city': 'Bangalore', 'sub_zone': 'Brigade Road', 'platform': 'zomato', 'res_id': 54400} 2025-03-31 00:39:29 [reviews] INFO: Stopping for res_id: 54400 as reviews are older than 7 days. 2025-03-31 00:39:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:39:33 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381513, 'download_latency': 0.9779524803161621, 'depth': 0} 2025-03-31 00:39:33 [reviews] INFO: Scraped item: {'review': 'Big hands to Avdhesh for lip smacking Biriyani', 'review_id': 291265244, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805} 2025-03-31 00:39:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=306805&page=1> {'review': 'Big hands to Avdhesh for lip smacking Biriyani', 'review_id': 291265244, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805} 2025-03-31 00:39:33 [reviews] INFO: Scraped item: {'review': 'No spoon , cold food & less salt', 'review_id': 291032524, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805} 2025-03-31 00:39:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=306805&page=1> {'review': 'No spoon , cold food & less salt', 'review_id': 291032524, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805} 2025-03-31 00:39:33 [reviews] INFO: Scraped item: {'review': 'Very nice preparation...delicious biryani...fresh.', 'review_id': 290998838, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805} 2025-03-31 00:39:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=306805&page=1> {'review': 'Very nice preparation...delicious biryani...fresh.', 'review_id': 290998838, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805} 2025-03-31 00:39:33 [reviews] INFO: Scraped item: {'review': 'the quantity of chicken was very less although the rice tasted fine.', 'review_id': 290964080, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805} 2025-03-31 00:39:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=306805&page=1> {'review': 'the quantity of chicken was very less although the rice tasted fine.', 'review_id': 290964080, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805} 2025-03-31 00:39:33 [reviews] INFO: Scraped item: {'review': 'gravy was less', 'review_id': 290145577, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805} 2025-03-31 00:39:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=306805&page=1> {'review': 'gravy was less', 'review_id': 290145577, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805} 2025-03-31 00:39:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:39:37 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381517, 'download_latency': 1.040163516998291, 'depth': 0} 2025-03-31 00:39:37 [reviews] INFO: Scraped item: {'review': 'Worst biryani ever had', 'review_id': 291772815, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995} 2025-03-31 00:39:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=312995&page=1> {'review': 'Worst biryani ever had', 'review_id': 291772815, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995} 2025-03-31 00:39:37 [reviews] INFO: Scraped item: {'review': "didn't got my order searched overnight ", 'review_id': 291454975, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995} 2025-03-31 00:39:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=312995&page=1> {'review': "didn't got my order searched overnight ", 'review_id': 291454975, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995} 2025-03-31 00:39:37 [reviews] INFO: Scraped item: {'review': 'Very good dishes. The Hyderabadi Dum Biryani deserves special mention.', 'review_id': 291163266, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995} 2025-03-31 00:39:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=312995&page=1> {'review': 'Very good dishes. The Hyderabadi Dum Biryani deserves special mention.', 'review_id': 291163266, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995} 2025-03-31 00:39:37 [reviews] INFO: Scraped item: {'review': 'it was tasteless ', 'review_id': 291019516, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995} 2025-03-31 00:39:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=312995&page=1> {'review': 'it was tasteless ', 'review_id': 291019516, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995} 2025-03-31 00:39:37 [reviews] INFO: Scraped item: {'review': 'Same order placed through my second mobile number every pot contains 4pcs this is totally fake just one piece in each container, last time phirani was given in matki but this time in plastic container. Very poor...', 'review_id': 291017673, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995} 2025-03-31 00:39:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=312995&page=1> {'review': 'Same order placed through my second mobile number every pot contains 4pcs this is totally fake just one piece in each container, last time phirani was given in matki but this time in plastic container. Very poor...', 'review_id': 291017673, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995} 2025-03-31 00:39:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:39:41 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 40, 'brand_name': 'The Fatty Bao', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 17871363, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381520, 'download_latency': 0.8425488471984863, 'depth': 0} 2025-03-31 00:39:41 [reviews] INFO: Scraped item: {'review': 'the edamame was not steamed correctly. the skin is still tough', 'review_id': 291522345, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 40, 'brand_name': 'The Fatty Bao', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 17871363} 2025-03-31 00:39:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=17871363&page=1> {'review': 'the edamame was not steamed correctly. the skin is still tough', 'review_id': 291522345, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 40, 'brand_name': 'The Fatty Bao', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 17871363} 2025-03-31 00:39:41 [reviews] INFO: Stopping for res_id: 17871363 as reviews are older than 7 days. 2025-03-31 00:39:43 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:39:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:39:47 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 46, 'brand_name': 'China House - Hyatt Regency', 'city': 'Ahmedabad', 'sub_zone': 'Hyatt Regency, Ashram Road ', 'platform': 'zomato', 'res_id': 18161729, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381527, 'download_latency': 1.0196707248687744, 'depth': 0} 2025-03-31 00:39:47 [reviews] INFO: Stopping for res_id: 18161729 as reviews are older than 7 days. 2025-03-31 00:39:49 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:39:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-31 00:39:53 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-31 00:39:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:39:55 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 18165909, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381533, 'download_latency': 0.8839378356933594, 'depth': 0} 2025-03-31 00:39:55 [reviews] INFO: Scraped item: {'review': "Food was very average. Biryani was very bland and only tasted of masala. Galoti kebab also very bland. And the soya chaap roll was too moist and soggy (it's surprising bcs I always order this from them but the quality is only dropped)", 'review_id': 291729756, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 18165909} 2025-03-31 00:39:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18165909&page=1> {'review': "Food was very average. Biryani was very bland and only tasted of masala. Galoti kebab also very bland. And the soya chaap roll was too moist and soggy (it's surprising bcs I always order this from them but the quality is only dropped)", 'review_id': 291729756, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 18165909} 2025-03-31 00:39:55 [reviews] INFO: Scraped item: {'review': 'not received order even after 2 hrs', 'review_id': 291151930, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 18165909} 2025-03-31 00:39:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18165909&page=1> {'review': 'not received order even after 2 hrs', 'review_id': 291151930, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 18165909} 2025-03-31 00:39:55 [reviews] INFO: Scraped item: {'review': 'Not worth the money.', 'review_id': 289708155, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 18165909} 2025-03-31 00:39:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18165909&page=1> {'review': 'Not worth the money.', 'review_id': 289708155, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 18165909} 2025-03-31 00:39:55 [reviews] INFO: Stopping for res_id: 18165909 as reviews are older than 7 days. 2025-03-31 00:39:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:39:59 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381540, 'download_latency': 1.1519968509674072, 'depth': 0} 2025-03-31 00:39:59 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291657859, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915} 2025-03-31 00:39:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18216915&page=1> {'review': '', 'review_id': 291657859, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915} 2025-03-31 00:39:59 [reviews] INFO: Scraped item: {'review': 'cold drink was missing in the order, for which I had already paid. very bad service ', 'review_id': 291599469, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915} 2025-03-31 00:39:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18216915&page=1> {'review': 'cold drink was missing in the order, for which I had already paid. very bad service ', 'review_id': 291599469, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915} 2025-03-31 00:39:59 [reviews] INFO: Scraped item: {'review': 'Good', 'review_id': 291406481, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915} 2025-03-31 00:39:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18216915&page=1> {'review': 'Good', 'review_id': 291406481, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915} 2025-03-31 00:39:59 [reviews] INFO: Scraped item: {'review': 'The food looked too good to wait for a picture. Perfectly served galouti kebabs. Absolutely fresh. Worth the money. Neatly packaged.', 'review_id': 291370452, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915} 2025-03-31 00:39:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18216915&page=1> {'review': 'The food looked too good to wait for a picture. Perfectly served galouti kebabs. Absolutely fresh. Worth the money. Neatly packaged.', 'review_id': 291370452, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915} 2025-03-31 00:39:59 [reviews] INFO: Scraped item: {'review': 'pathetic ', 'review_id': 290924109, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915} 2025-03-31 00:39:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18216915&page=1> {'review': 'pathetic ', 'review_id': 290924109, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915} 2025-03-31 00:40:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:40:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:40:11 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:40:15 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:40:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:40:22 [scrapy.extensions.logstats] INFO: Crawled 47 pages (at 8 pages/min), scraped 137 items (at 25 items/min) 2025-03-31 00:40:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-31 00:40:23 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-31 00:40:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:40:24 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Kandivali East', 'platform': 'zomato', 'res_id': 18257196, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381560, 'download_latency': 1.7875053882598877, 'depth': 0} 2025-03-31 00:40:24 [reviews] ERROR: Unrecognized relative_date format: may 27, 2021 2025-03-31 00:40:24 [reviews] INFO: Stopping for res_id: 18257196 due to unrecognized date format: May 27, 2021. 2025-03-31 00:40:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:40:26 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 89, 'brand_name': 'Gowalia Tank Dairy Farm', 'city': 'Mumbai', 'sub_zone': 'Gowalia Tank Road', 'platform': 'zomato', 'res_id': 18257369, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381565, 'download_latency': 1.0025646686553955, 'depth': 0} 2025-03-31 00:40:26 [reviews] INFO: Scraped item: {'review': 'Pizza base was baked to much', 'review_id': 290889688, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 89, 'brand_name': 'Gowalia Tank Dairy Farm', 'city': 'Mumbai', 'sub_zone': 'Gowalia Tank Road', 'platform': 'zomato', 'res_id': 18257369} 2025-03-31 00:40:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18257369&page=1> {'review': 'Pizza base was baked to much', 'review_id': 290889688, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 89, 'brand_name': 'Gowalia Tank Dairy Farm', 'city': 'Mumbai', 'sub_zone': 'Gowalia Tank Road', 'platform': 'zomato', 'res_id': 18257369} 2025-03-31 00:40:26 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290168136, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 89, 'brand_name': 'Gowalia Tank Dairy Farm', 'city': 'Mumbai', 'sub_zone': 'Gowalia Tank Road', 'platform': 'zomato', 'res_id': 18257369} 2025-03-31 00:40:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18257369&page=1> {'review': '', 'review_id': 290168136, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 89, 'brand_name': 'Gowalia Tank Dairy Farm', 'city': 'Mumbai', 'sub_zone': 'Gowalia Tank Road', 'platform': 'zomato', 'res_id': 18257369} 2025-03-31 00:40:26 [reviews] INFO: Stopping for res_id: 18257369 as reviews are older than 7 days. 2025-03-31 00:40:29 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:40:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:40:35 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381573, 'download_latency': 1.2836413383483887, 'depth': 0} 2025-03-31 00:40:35 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291027210, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118} 2025-03-31 00:40:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18324118&page=1> {'review': '', 'review_id': 291027210, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118} 2025-03-31 00:40:35 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290899120, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118} 2025-03-31 00:40:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18324118&page=1> {'review': '', 'review_id': 290899120, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118} 2025-03-31 00:40:35 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290326030, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118} 2025-03-31 00:40:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18324118&page=1> {'review': '', 'review_id': 290326030, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118} 2025-03-31 00:40:35 [reviews] INFO: Scraped item: {'review': 'Pulao was very tasty, Thank you so much!', 'review_id': 290233200, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118} 2025-03-31 00:40:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18324118&page=1> {'review': 'Pulao was very tasty, Thank you so much!', 'review_id': 290233200, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118} 2025-03-31 00:40:35 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290205053, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118} 2025-03-31 00:40:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18324118&page=1> {'review': '', 'review_id': 290205053, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118} 2025-03-31 00:40:38 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:40:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:40:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:40:47 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Phoenix Marketcity (Kurla)', 'platform': 'zomato', 'res_id': 18326064, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381583, 'download_latency': 1.0369482040405273, 'depth': 0} 2025-03-31 00:40:47 [reviews] INFO: Scraped item: {'review': 'normal rice ', 'review_id': 290610040, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Phoenix Marketcity (Kurla)', 'platform': 'zomato', 'res_id': 18326064} 2025-03-31 00:40:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18326064&page=1> {'review': 'normal rice ', 'review_id': 290610040, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Phoenix Marketcity (Kurla)', 'platform': 'zomato', 'res_id': 18326064} 2025-03-31 00:40:47 [reviews] INFO: Stopping for res_id: 18326064 as reviews are older than 7 days. 2025-03-31 00:40:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:40:50 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381587, 'download_latency': 0.8314917087554932, 'depth': 0} 2025-03-31 00:40:50 [reviews] INFO: Scraped item: {'review': 'worthless biryani', 'review_id': 291733195, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461} 2025-03-31 00:40:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18349461&page=1> {'review': 'worthless biryani', 'review_id': 291733195, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461} 2025-03-31 00:40:50 [reviews] INFO: Scraped item: {'review': 'taste was exceptional but portion size was really small for the amount of money ', 'review_id': 291682737, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461} 2025-03-31 00:40:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18349461&page=1> {'review': 'taste was exceptional but portion size was really small for the amount of money ', 'review_id': 291682737, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461} 2025-03-31 00:40:50 [reviews] INFO: Scraped item: {'review': 'superb osm taste๐Ÿ™Œ๐Ÿ‘๐Ÿ‘๐Ÿ‘๐ŸคŸ๐Ÿค', 'review_id': 291357845, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461} 2025-03-31 00:40:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18349461&page=1> {'review': 'superb osm taste๐Ÿ™Œ๐Ÿ‘๐Ÿ‘๐Ÿ‘๐ŸคŸ๐Ÿค', 'review_id': 291357845, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461} 2025-03-31 00:40:50 [reviews] INFO: Scraped item: {'review': "SHD never disappoints. It's one of my favorite restaurants.", 'review_id': 290564086, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461} 2025-03-31 00:40:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18349461&page=1> {'review': "SHD never disappoints. It's one of my favorite restaurants.", 'review_id': 290564086, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461} 2025-03-31 00:40:50 [reviews] INFO: Scraped item: {'review': 'Kebab taste was weird and rice in biryani was too dry', 'review_id': 290544470, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461} 2025-03-31 00:40:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18349461&page=1> {'review': 'Kebab taste was weird and rice in biryani was too dry', 'review_id': 290544470, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461} 2025-03-31 00:40:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:40:54 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18350121, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381590, 'download_latency': 1.1816365718841553, 'depth': 0} 2025-03-31 00:40:54 [reviews] INFO: Scraped item: {'review': 'taste is excellent ', 'review_id': 290763035, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18350121} 2025-03-31 00:40:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18350121&page=1> {'review': 'taste is excellent ', 'review_id': 290763035, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18350121} 2025-03-31 00:40:54 [reviews] INFO: Scraped item: {'review': 'not good ', 'review_id': 290398265, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18350121} 2025-03-31 00:40:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18350121&page=1> {'review': 'not good ', 'review_id': 290398265, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18350121} 2025-03-31 00:40:54 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290049983, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18350121} 2025-03-31 00:40:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18350121&page=1> {'review': '', 'review_id': 290049983, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18350121} 2025-03-31 00:40:54 [reviews] INFO: Scraped item: {'review': '', 'review_id': 289962700, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18350121} 2025-03-31 00:40:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18350121&page=1> {'review': '', 'review_id': 289962700, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18350121} 2025-03-31 00:40:54 [reviews] INFO: Stopping for res_id: 18350121 as reviews are older than 7 days. 2025-03-31 00:40:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:40:58 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381595, 'download_latency': 0.8370480537414551, 'depth': 0} 2025-03-31 00:40:58 [reviews] INFO: Scraped item: {'review': 'I ordered paneer biryani and got non veg dum gosht biryani', 'review_id': 291629727, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082} 2025-03-31 00:40:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18363082&page=1> {'review': 'I ordered paneer biryani and got non veg dum gosht biryani', 'review_id': 291629727, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082} 2025-03-31 00:40:58 [reviews] INFO: Scraped item: {'review': 'Okayish but overpriced', 'review_id': 291372141, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082} 2025-03-31 00:40:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18363082&page=1> {'review': 'Okayish but overpriced', 'review_id': 291372141, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082} 2025-03-31 00:40:58 [reviews] INFO: Scraped item: {'review': 'very bad food', 'review_id': 291298385, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082} 2025-03-31 00:40:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18363082&page=1> {'review': 'very bad food', 'review_id': 291298385, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082} 2025-03-31 00:40:58 [reviews] INFO: Scraped item: {'review': 'No pickle chutney green chilly onion sent . How does one eat a kebab without onion and chutney', 'review_id': 291243712, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082} 2025-03-31 00:40:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18363082&page=1> {'review': 'No pickle chutney green chilly onion sent . How does one eat a kebab without onion and chutney', 'review_id': 291243712, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082} 2025-03-31 00:40:58 [reviews] INFO: Scraped item: {'review': 'good taste, quantity has been reduced going with time, which should not be the case :)', 'review_id': 291030716, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082} 2025-03-31 00:40:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18363082&page=1> {'review': 'good taste, quantity has been reduced going with time, which should not be the case :)', 'review_id': 291030716, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082} 2025-03-31 00:41:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:41:02 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381599, 'download_latency': 0.9142880439758301, 'depth': 0} 2025-03-31 00:41:02 [reviews] INFO: Scraped item: {'review': 'Very nice', 'review_id': 291737955, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184} 2025-03-31 00:41:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365184&page=1> {'review': 'Very nice', 'review_id': 291737955, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184} 2025-03-31 00:41:02 [reviews] INFO: Scraped item: {'review': 'Great food', 'review_id': 291703366, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184} 2025-03-31 00:41:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365184&page=1> {'review': 'Great food', 'review_id': 291703366, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184} 2025-03-31 00:41:02 [reviews] INFO: Scraped item: {'review': 'Food is nice', 'review_id': 291687837, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184} 2025-03-31 00:41:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365184&page=1> {'review': 'Food is nice', 'review_id': 291687837, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184} 2025-03-31 00:41:02 [reviews] INFO: Scraped item: {'review': 'Food is good and also staff is well behaved', 'review_id': 291680838, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184} 2025-03-31 00:41:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365184&page=1> {'review': 'Food is good and also staff is well behaved', 'review_id': 291680838, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184} 2025-03-31 00:41:02 [reviews] INFO: Scraped item: {'review': 'Amazing place', 'review_id': 291673270, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184} 2025-03-31 00:41:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365184&page=1> {'review': 'Amazing place', 'review_id': 291673270, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184} 2025-03-31 00:41:05 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:41:08 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:41:12 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:41:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:41:19 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:41:21 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:41:22 [scrapy.extensions.logstats] INFO: Crawled 55 pages (at 8 pages/min), scraped 164 items (at 27 items/min) 2025-03-31 00:41:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-31 00:41:23 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-31 00:41:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:41:25 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18365355, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381626, 'download_latency': 1.193446397781372, 'depth': 0} 2025-03-31 00:41:25 [reviews] INFO: Scraped item: {'review': "Biryani didn't had proper masala... Last time I ordered it was too delicious but this time spices and masala isn't proper. really had bad experience this time.", 'review_id': 290977129, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18365355} 2025-03-31 00:41:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365355&page=1> {'review': "Biryani didn't had proper masala... Last time I ordered it was too delicious but this time spices and masala isn't proper. really had bad experience this time.", 'review_id': 290977129, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18365355} 2025-03-31 00:41:25 [reviews] INFO: Scraped item: {'review': '9/10 Biryani very very tasty and huge portion', 'review_id': 290970506, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18365355} 2025-03-31 00:41:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365355&page=1> {'review': '9/10 Biryani very very tasty and huge portion', 'review_id': 290970506, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18365355} 2025-03-31 00:41:25 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290660779, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18365355} 2025-03-31 00:41:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365355&page=1> {'review': '', 'review_id': 290660779, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18365355} 2025-03-31 00:41:25 [reviews] INFO: Scraped item: {'review': 'Iteams not proper coldrings', 'review_id': 290295142, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18365355} 2025-03-31 00:41:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365355&page=1> {'review': 'Iteams not proper coldrings', 'review_id': 290295142, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18365355} 2025-03-31 00:41:25 [reviews] INFO: Scraped item: {'review': 'Had a really good haleem after so long', 'review_id': 290014916, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18365355} 2025-03-31 00:41:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365355&page=1> {'review': 'Had a really good haleem after so long', 'review_id': 290014916, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18365355} 2025-03-31 00:41:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:41:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:41:31 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381635, 'download_latency': 2.1794168949127197, 'depth': 0} 2025-03-31 00:41:31 [reviews] INFO: Scraped item: {'review': 'The soup is very cold like it was packed like an hour ago... and also the soup has ghee frozen on the top of package.', 'review_id': 291411324, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868} 2025-03-31 00:41:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365868&page=1> {'review': 'The soup is very cold like it was packed like an hour ago... and also the soup has ghee frozen on the top of package.', 'review_id': 291411324, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868} 2025-03-31 00:41:31 [reviews] INFO: Scraped item: {'review': 'The Biryani was ok and the gulab jamun was below standard as it was too hard.', 'review_id': 291400198, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868} 2025-03-31 00:41:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365868&page=1> {'review': 'The Biryani was ok and the gulab jamun was below standard as it was too hard.', 'review_id': 291400198, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868} 2025-03-31 00:41:31 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291223796, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868} 2025-03-31 00:41:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365868&page=1> {'review': '', 'review_id': 291223796, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868} 2025-03-31 00:41:31 [reviews] INFO: Scraped item: {'review': 'AWESOME (ZABARDAST) TASTE.', 'review_id': 290969927, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868} 2025-03-31 00:41:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365868&page=1> {'review': 'AWESOME (ZABARDAST) TASTE.', 'review_id': 290969927, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868} 2025-03-31 00:41:31 [reviews] INFO: Scraped item: {'review': 'i love their biryani but this time it came with a surprise!! Chef Pankaj, you made my day ', 'review_id': 290764997, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868} 2025-03-31 00:41:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365868&page=1> {'review': 'i love their biryani but this time it came with a surprise!! Chef Pankaj, you made my day ', 'review_id': 290764997, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868} 2025-03-31 00:41:33 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:41:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:41:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:41:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:41:47 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381650, 'download_latency': 2.6283111572265625, 'depth': 0} 2025-03-31 00:41:47 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291308868, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882} 2025-03-31 00:41:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365882&page=1> {'review': '', 'review_id': 291308868, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882} 2025-03-31 00:41:47 [reviews] INFO: Scraped item: {'review': 'quantity was very less', 'review_id': 291284281, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882} 2025-03-31 00:41:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365882&page=1> {'review': 'quantity was very less', 'review_id': 291284281, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882} 2025-03-31 00:41:47 [reviews] INFO: Scraped item: {'review': 'There was hardly any chicken in Chicken biryani', 'review_id': 290711872, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882} 2025-03-31 00:41:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365882&page=1> {'review': 'There was hardly any chicken in Chicken biryani', 'review_id': 290711872, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882} 2025-03-31 00:41:47 [reviews] INFO: Scraped item: {'review': 'Dahi Labneh kebab was okay okay and about biryani paneer dum is more delicious than this veg dum', 'review_id': 290173357, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882} 2025-03-31 00:41:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365882&page=1> {'review': 'Dahi Labneh kebab was okay okay and about biryani paneer dum is more delicious than this veg dum', 'review_id': 290173357, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882} 2025-03-31 00:41:47 [reviews] INFO: Scraped item: {'review': 'Not at all worthy of price no taste no ,no quantity and very less pieces of chicken.... regretting like anything ', 'review_id': 289731874, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882} 2025-03-31 00:41:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365882&page=1> {'review': 'Not at all worthy of price no taste no ,no quantity and very less pieces of chicken.... regretting like anything ', 'review_id': 289731874, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882} 2025-03-31 00:41:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:41:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:41:53 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381659, 'download_latency': 1.0363740921020508, 'depth': 0} 2025-03-31 00:41:53 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291169884, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897} 2025-03-31 00:41:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365897&page=1> {'review': '', 'review_id': 291169884, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897} 2025-03-31 00:41:53 [reviews] INFO: Scraped item: {'review': 'everything ๐Ÿคฉ is great so tasty just little less spicy as I mentioned on cooking instruction.', 'review_id': 290056579, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897} 2025-03-31 00:41:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365897&page=1> {'review': 'everything ๐Ÿคฉ is great so tasty just little less spicy as I mentioned on cooking instruction.', 'review_id': 290056579, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897} 2025-03-31 00:41:53 [reviews] INFO: Scraped item: {'review': 'quantity is toooo less for the price!', 'review_id': 289704597, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897} 2025-03-31 00:41:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365897&page=1> {'review': 'quantity is toooo less for the price!', 'review_id': 289704597, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897} 2025-03-31 00:41:53 [reviews] INFO: Scraped item: {'review': 'portion was less', 'review_id': 289671421, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897} 2025-03-31 00:41:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365897&page=1> {'review': 'portion was less', 'review_id': 289671421, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897} 2025-03-31 00:41:53 [reviews] INFO: Stopping for res_id: 18365897 as reviews are older than 7 days. 2025-03-31 00:41:55 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:41:59 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:42:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:42:06 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:42:10 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:42:13 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:42:17 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:42:22 [scrapy.extensions.logstats] INFO: Crawled 59 pages (at 4 pages/min), scraped 183 items (at 19 items/min) 2025-03-31 00:42:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:42:22 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18365991, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381686, 'download_latency': 1.2845458984375, 'depth': 0} 2025-03-31 00:42:22 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291144166, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18365991} 2025-03-31 00:42:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365991&page=1> {'review': '', 'review_id': 291144166, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18365991} 2025-03-31 00:42:22 [reviews] INFO: Scraped item: {'review': 'Best biryani ever thank you chef nikhilfor this biryani', 'review_id': 290990582, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18365991} 2025-03-31 00:42:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365991&page=1> {'review': 'Best biryani ever thank you chef nikhilfor this biryani', 'review_id': 290990582, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18365991} 2025-03-31 00:42:22 [reviews] INFO: Scraped item: {'review': 'Absolutely Cold food. Delayed order', 'review_id': 290686346, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18365991} 2025-03-31 00:42:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365991&page=1> {'review': 'Absolutely Cold food. Delayed order', 'review_id': 290686346, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18365991} 2025-03-31 00:42:22 [reviews] INFO: Scraped item: {'review': 'best', 'review_id': 290338717, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18365991} 2025-03-31 00:42:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365991&page=1> {'review': 'best', 'review_id': 290338717, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18365991} 2025-03-31 00:42:22 [reviews] INFO: Scraped item: {'review': 'beautiful and delicious ๐Ÿ˜‹', 'review_id': 290143600, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18365991} 2025-03-31 00:42:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365991&page=1> {'review': 'beautiful and delicious ๐Ÿ˜‹', 'review_id': 290143600, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18365991} 2025-03-31 00:42:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-31 00:42:23 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-31 00:42:25 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:42:29 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:42:33 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:42:37 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:42:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:42:43 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:42:45 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:42:48 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:42:51 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:42:55 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:43:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:43:04 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:43:08 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:43:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:43:12 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18368221, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381733, 'download_latency': 0.916348934173584, 'depth': 0} 2025-03-31 00:43:12 [reviews] INFO: Scraped item: {'review': 'good ', 'review_id': 291735777, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18368221} 2025-03-31 00:43:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18368221&page=1> {'review': 'good ', 'review_id': 291735777, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18368221} 2025-03-31 00:43:12 [reviews] INFO: Scraped item: {'review': 'Expectations lead to disappointments', 'review_id': 291540706, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18368221} 2025-03-31 00:43:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18368221&page=1> {'review': 'Expectations lead to disappointments', 'review_id': 291540706, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18368221} 2025-03-31 00:43:12 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290531051, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18368221} 2025-03-31 00:43:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18368221&page=1> {'review': '', 'review_id': 290531051, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18368221} 2025-03-31 00:43:12 [reviews] INFO: Stopping for res_id: 18368221 as reviews are older than 7 days. 2025-03-31 00:43:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:43:16 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381737, 'download_latency': 1.3517863750457764, 'depth': 0} 2025-03-31 00:43:16 [reviews] INFO: Scraped item: {'review': 'Haleem did not have any dry fruits or barista onion. Kebab was cold and did not seem fresh', 'review_id': 291734121, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009} 2025-03-31 00:43:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372009&page=1> {'review': 'Haleem did not have any dry fruits or barista onion. Kebab was cold and did not seem fresh', 'review_id': 291734121, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009} 2025-03-31 00:43:16 [reviews] INFO: Scraped item: {'review': 'Bad food quality, wastage of money, we order mutton haleem we were very disappointed with the taste not good at all..', 'review_id': 290880181, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009} 2025-03-31 00:43:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372009&page=1> {'review': 'Bad food quality, wastage of money, we order mutton haleem we were very disappointed with the taste not good at all..', 'review_id': 290880181, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009} 2025-03-31 00:43:16 [reviews] INFO: Scraped item: {'review': 'too much of gravymasala and less of rice . but the taste was good ', 'review_id': 290105113, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009} 2025-03-31 00:43:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372009&page=1> {'review': 'too much of gravymasala and less of rice . but the taste was good ', 'review_id': 290105113, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009} 2025-03-31 00:43:16 [reviews] INFO: Stopping for res_id: 18372009 as reviews are older than 7 days. 2025-03-31 00:43:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:43:19 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381743, 'download_latency': 1.1294834613800049, 'depth': 0} 2025-03-31 00:43:19 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291489085, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044} 2025-03-31 00:43:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372044&page=1> {'review': '', 'review_id': 291489085, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044} 2025-03-31 00:43:19 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291489013, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044} 2025-03-31 00:43:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372044&page=1> {'review': '', 'review_id': 291489013, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044} 2025-03-31 00:43:19 [reviews] INFO: Scraped item: {'review': "the biryani was cold n not tasty at all was wet
tikkis we're dry
shahi tuka was freezed instant of hot
the food was delivered late and was cold
instead of shorba halem was provided
I wish I had taken pics
", 'review_id': 291336259, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044} 2025-03-31 00:43:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372044&page=1> {'review': "the biryani was cold n not tasty at all was wet
tikkis we're dry
shahi tuka was freezed instant of hot
the food was delivered late and was cold
instead of shorba halem was provided
I wish I had taken pics
", 'review_id': 291336259, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044} 2025-03-31 00:43:19 [reviews] INFO: Scraped item: {'review': 'Average preparation.', 'review_id': 291234190, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044} 2025-03-31 00:43:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372044&page=1> {'review': 'Average preparation.', 'review_id': 291234190, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044} 2025-03-31 00:43:19 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291004723, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044} 2025-03-31 00:43:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372044&page=1> {'review': '', 'review_id': 291004723, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044} 2025-03-31 00:43:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:43:22 [scrapy.extensions.logstats] INFO: Crawled 63 pages (at 4 pages/min), scraped 199 items (at 16 items/min) 2025-03-31 00:43:26 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:43:30 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:43:34 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:43:37 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:43:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:43:44 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:43:47 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:43:51 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:43:55 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:43:59 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:44:03 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:44:05 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:44:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:44:17 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 56, 'brand_name': 'Noshi - Yum Asian Delivery', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18382342, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381796, 'download_latency': 4.5933167934417725, 'depth': 0} 2025-03-31 00:44:17 [reviews] INFO: Scraped item: {'review': 'I got food poisoning', 'review_id': 291643041, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 56, 'brand_name': 'Noshi - Yum Asian Delivery', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18382342} 2025-03-31 00:44:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18382342&page=1> {'review': 'I got food poisoning', 'review_id': 291643041, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 56, 'brand_name': 'Noshi - Yum Asian Delivery', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18382342} 2025-03-31 00:44:17 [reviews] INFO: Scraped item: {'review': '', 'review_id': 289979746, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 56, 'brand_name': 'Noshi - Yum Asian Delivery', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18382342} 2025-03-31 00:44:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18382342&page=1> {'review': '', 'review_id': 289979746, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 56, 'brand_name': 'Noshi - Yum Asian Delivery', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18382342} 2025-03-31 00:44:17 [reviews] INFO: Stopping for res_id: 18382342 as reviews are older than 7 days. 2025-03-31 00:44:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:44:18 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 91, 'brand_name': 'Chai Point', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 18435901, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381799, 'download_latency': 1.7254385948181152, 'depth': 0} 2025-03-31 00:44:18 [reviews] INFO: Stopping for res_id: 18435901 as reviews are older than 7 days. 2025-03-31 00:44:19 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:44:21 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): [] 2025-03-31 00:44:22 [scrapy.extensions.logstats] INFO: Crawled 65 pages (at 2 pages/min), scraped 201 items (at 2 items/min) 2025-03-31 00:44:23 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:44:25 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:44:30 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:44:34 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:44:38 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:44:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:44:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:44:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:44:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:44:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:45:03 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:45:06 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:45:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:45:12 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381858, 'download_latency': 1.6030025482177734, 'depth': 0} 2025-03-31 00:45:12 [reviews] INFO: Scraped item: {'review': "the veg kebab was half cooked. and can't be consumed", 'review_id': 291324060, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182} 2025-03-31 00:45:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18440182&page=1> {'review': "the veg kebab was half cooked. and can't be consumed", 'review_id': 291324060, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182} 2025-03-31 00:45:12 [reviews] INFO: Scraped item: {'review': 'They sent the wrong order, I order veg biryani and then sent us the non veg biryani and we are pure veg, they did a fraud', 'review_id': 291205740, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182} 2025-03-31 00:45:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18440182&page=1> {'review': 'They sent the wrong order, I order veg biryani and then sent us the non veg biryani and we are pure veg, they did a fraud', 'review_id': 291205740, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182} 2025-03-31 00:45:12 [reviews] INFO: Scraped item: {'review': 'Empty container', 'review_id': 290977058, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182} 2025-03-31 00:45:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18440182&page=1> {'review': 'Empty container', 'review_id': 290977058, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182} 2025-03-31 00:45:12 [reviews] INFO: Scraped item: {'review': 'The delivery was delayed by at-least 30 mins by the restaurant for preparing the order. The packaging was also not good. Most of the salan leaked in the package itself. There was no issue or delay by the delivery personnel.', 'review_id': 290974421, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182} 2025-03-31 00:45:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18440182&page=1> {'review': 'The delivery was delayed by at-least 30 mins by the restaurant for preparing the order. The packaging was also not good. Most of the salan leaked in the package itself. There was no issue or delay by the delivery personnel.', 'review_id': 290974421, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182} 2025-03-31 00:45:12 [reviews] INFO: Scraped item: {'review': 'the biryani was tasteless.. not even salt was added properly

did not enjoy our food', 'review_id': 290218841, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182} 2025-03-31 00:45:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18440182&page=1> {'review': 'the biryani was tasteless.. not even salt was added properly

did not enjoy our food', 'review_id': 290218841, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182} 2025-03-31 00:45:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:45:13 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381858, 'download_latency': 0.6744084358215332, 'depth': 0} 2025-03-31 00:45:13 [reviews] INFO: Scraped item: {'review': 'Very tasteless food', 'review_id': 291711962, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435} 2025-03-31 00:45:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18466435&page=1> {'review': 'Very tasteless food', 'review_id': 291711962, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435} 2025-03-31 00:45:13 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291477328, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435} 2025-03-31 00:45:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18466435&page=1> {'review': '', 'review_id': 291477328, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435} 2025-03-31 00:45:13 [reviews] INFO: Scraped item: {'review': 'SEEXAAAAYYYYYY', 'review_id': 291329109, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435} 2025-03-31 00:45:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18466435&page=1> {'review': 'SEEXAAAAYYYYYY', 'review_id': 291329109, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435} 2025-03-31 00:45:13 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291040616, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435} 2025-03-31 00:45:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18466435&page=1> {'review': '', 'review_id': 291040616, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435} 2025-03-31 00:45:13 [reviews] INFO: Scraped item: {'review': 'It was very sour', 'review_id': 290942390, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435} 2025-03-31 00:45:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18466435&page=1> {'review': 'It was very sour', 'review_id': 290942390, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435} 2025-03-31 00:45:17 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:45:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:45:20 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381862, 'retry_times': 1, 'download_latency': 0.7014973163604736, 'depth': 0} 2025-03-31 00:45:20 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291327870, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663} 2025-03-31 00:45:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18381663&page=1> {'review': '', 'review_id': 291327870, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663} 2025-03-31 00:45:20 [reviews] INFO: Scraped item: {'review': 'Bland rolls; lack of taste', 'review_id': 291251539, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663} 2025-03-31 00:45:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18381663&page=1> {'review': 'Bland rolls; lack of taste', 'review_id': 291251539, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663} 2025-03-31 00:45:20 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291164461, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663} 2025-03-31 00:45:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18381663&page=1> {'review': '', 'review_id': 291164461, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663} 2025-03-31 00:45:20 [reviews] INFO: Scraped item: {'review': 'low quantity High price..', 'review_id': 290735857, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663} 2025-03-31 00:45:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18381663&page=1> {'review': 'low quantity High price..', 'review_id': 290735857, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663} 2025-03-31 00:45:20 [reviews] INFO: Scraped item: {'review': "Raita was full of red chilli powder and didn't taste nice. Veg roll also didn't taste good", 'review_id': 290392350, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663} 2025-03-31 00:45:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18381663&page=1> {'review': "Raita was full of red chilli powder and didn't taste nice. Veg roll also didn't taste good", 'review_id': 290392350, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663} 2025-03-31 00:45:22 [scrapy.extensions.logstats] INFO: Crawled 68 pages (at 3 pages/min), scraped 216 items (at 15 items/min) 2025-03-31 00:45:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:45:28 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:45:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:45:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:45:40 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:45:43 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:45:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:45:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:45:53 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:45:57 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:46:02 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:46:05 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:46:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:46:09 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 88, 'brand_name': 'Sanjay Vegetarian Corner & Juice Center', 'city': 'Mumbai', 'sub_zone': 'Girgaum', 'platform': 'zomato', 'res_id': 18520205, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381912, 'download_latency': 0.727179765701294, 'depth': 0} 2025-03-31 00:46:09 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291599276, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 88, 'brand_name': 'Sanjay Vegetarian Corner & Juice Center', 'city': 'Mumbai', 'sub_zone': 'Girgaum', 'platform': 'zomato', 'res_id': 18520205} 2025-03-31 00:46:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18520205&page=1> {'review': '', 'review_id': 291599276, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 88, 'brand_name': 'Sanjay Vegetarian Corner & Juice Center', 'city': 'Mumbai', 'sub_zone': 'Girgaum', 'platform': 'zomato', 'res_id': 18520205} 2025-03-31 00:46:09 [reviews] INFO: Scraped item: {'review': '', 'review_id': 289987622, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 88, 'brand_name': 'Sanjay Vegetarian Corner & Juice Center', 'city': 'Mumbai', 'sub_zone': 'Girgaum', 'platform': 'zomato', 'res_id': 18520205} 2025-03-31 00:46:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18520205&page=1> {'review': '', 'review_id': 289987622, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 88, 'brand_name': 'Sanjay Vegetarian Corner & Juice Center', 'city': 'Mumbai', 'sub_zone': 'Girgaum', 'platform': 'zomato', 'res_id': 18520205} 2025-03-31 00:46:09 [reviews] INFO: Stopping for res_id: 18520205 as reviews are older than 7 days. 2025-03-31 00:46:13 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:46:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:46:19 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:46:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:46:22 [scrapy.extensions.logstats] INFO: Crawled 69 pages (at 1 pages/min), scraped 218 items (at 2 items/min) 2025-03-31 00:46:26 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:46:29 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:46:33 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:46:36 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:46:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:46:44 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:46:49 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:46:51 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:46:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:46:55 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381958, 'download_latency': 0.7262616157531738, 'depth': 0} 2025-03-31 00:46:55 [reviews] INFO: Scraped item: {'review': 'Good ๐Ÿ‘ ', 'review_id': 291341231, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370} 2025-03-31 00:46:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18535370&page=1> {'review': 'Good ๐Ÿ‘ ', 'review_id': 291341231, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370} 2025-03-31 00:46:55 [reviews] INFO: Scraped item: {'review': 'The quantity of the Food is very low.', 'review_id': 291150073, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370} 2025-03-31 00:46:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18535370&page=1> {'review': 'The quantity of the Food is very low.', 'review_id': 291150073, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370} 2025-03-31 00:46:55 [reviews] INFO: Scraped item: {'review': 'Biryani should made more flavoured', 'review_id': 291046105, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370} 2025-03-31 00:46:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18535370&page=1> {'review': 'Biryani should made more flavoured', 'review_id': 291046105, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370} 2025-03-31 00:46:55 [reviews] INFO: Scraped item: {'review': 'Today was really bad. Maybe its different at different outlets.', 'review_id': 290814990, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370} 2025-03-31 00:46:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18535370&page=1> {'review': 'Today was really bad. Maybe its different at different outlets.', 'review_id': 290814990, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370} 2025-03-31 00:46:55 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290609263, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370} 2025-03-31 00:46:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18535370&page=1> {'review': '', 'review_id': 290609263, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370} 2025-03-31 00:46:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:46:59 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 55, 'brand_name': 'Enoki - Fresh Asian Kitchen', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18537577, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381962, 'download_latency': 0.7448616027832031, 'depth': 0} 2025-03-31 00:46:59 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291032891, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 55, 'brand_name': 'Enoki - Fresh Asian Kitchen', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18537577} 2025-03-31 00:46:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18537577&page=1> {'review': '', 'review_id': 291032891, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 55, 'brand_name': 'Enoki - Fresh Asian Kitchen', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18537577} 2025-03-31 00:46:59 [reviews] INFO: Scraped item: {'review': 'does not taste good...instead of crispy...the noodles are burnt ', 'review_id': 290673052, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 55, 'brand_name': 'Enoki - Fresh Asian Kitchen', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18537577} 2025-03-31 00:46:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18537577&page=1> {'review': 'does not taste good...instead of crispy...the noodles are burnt ', 'review_id': 290673052, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 55, 'brand_name': 'Enoki - Fresh Asian Kitchen', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18537577} 2025-03-31 00:46:59 [reviews] INFO: Scraped item: {'review': 'amazing food and amazing service from the Zomato driver and Zomato', 'review_id': 290488151, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 55, 'brand_name': 'Enoki - Fresh Asian Kitchen', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18537577} 2025-03-31 00:46:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18537577&page=1> {'review': 'amazing food and amazing service from the Zomato driver and Zomato', 'review_id': 290488151, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 55, 'brand_name': 'Enoki - Fresh Asian Kitchen', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18537577} 2025-03-31 00:46:59 [reviews] INFO: Scraped item: {'review': 'too spicy', 'review_id': 289927472, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 55, 'brand_name': 'Enoki - Fresh Asian Kitchen', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18537577} 2025-03-31 00:46:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18537577&page=1> {'review': 'too spicy', 'review_id': 289927472, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 55, 'brand_name': 'Enoki - Fresh Asian Kitchen', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18537577} 2025-03-31 00:46:59 [reviews] INFO: Stopping for res_id: 18537577 as reviews are older than 7 days. 2025-03-31 00:47:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:47:03 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 53, 'brand_name': 'Yum Yum Cha', 'city': 'New Delhi', 'sub_zone': 'Khan Market', 'platform': 'zomato', 'res_id': 18544058, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381965, 'download_latency': 0.7422819137573242, 'depth': 0} 2025-03-31 00:47:03 [reviews] INFO: Scraped item: {'review': 'Lovely food good service by kuldeep', 'review_id': 290252003, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-27', 'competitor_id': 53, 'brand_name': 'Yum Yum Cha', 'city': 'New Delhi', 'sub_zone': 'Khan Market', 'platform': 'zomato', 'res_id': 18544058} 2025-03-31 00:47:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18544058&page=1> {'review': 'Lovely food good service by kuldeep', 'review_id': 290252003, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-27', 'competitor_id': 53, 'brand_name': 'Yum Yum Cha', 'city': 'New Delhi', 'sub_zone': 'Khan Market', 'platform': 'zomato', 'res_id': 18544058} 2025-03-31 00:47:03 [reviews] INFO: Stopping for res_id: 18544058 as reviews are older than 7 days. 2025-03-31 00:47:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:47:06 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381969, 'download_latency': 0.7095959186553955, 'depth': 0} 2025-03-31 00:47:06 [reviews] INFO: Scraped item: {'review': 'food was not cooked well ', 'review_id': 291694080, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628} 2025-03-31 00:47:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18547628&page=1> {'review': 'food was not cooked well ', 'review_id': 291694080, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628} 2025-03-31 00:47:06 [reviews] INFO: Scraped item: {'review': 'Good food', 'review_id': 291498251, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628} 2025-03-31 00:47:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18547628&page=1> {'review': 'Good food', 'review_id': 291498251, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628} 2025-03-31 00:47:06 [reviews] INFO: Scraped item: {'review': 'Hardly any chicken in chicken biryani.', 'review_id': 291304689, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628} 2025-03-31 00:47:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18547628&page=1> {'review': 'Hardly any chicken in chicken biryani.', 'review_id': 291304689, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628} 2025-03-31 00:47:06 [reviews] INFO: Scraped item: {'review': 'Very tasty and clean packaging', 'review_id': 290488789, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628} 2025-03-31 00:47:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18547628&page=1> {'review': 'Very tasty and clean packaging', 'review_id': 290488789, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628} 2025-03-31 00:47:06 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290360398, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628} 2025-03-31 00:47:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18547628&page=1> {'review': '', 'review_id': 290360398, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628} 2025-03-31 00:47:08 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:47:12 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:47:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:47:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:47:22 [scrapy.extensions.logstats] INFO: Crawled 73 pages (at 4 pages/min), scraped 233 items (at 15 items/min) 2025-03-31 00:47:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-31 00:47:23 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-31 00:47:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:47:27 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:47:32 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:47:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:47:36 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743381997, 'download_latency': 0.7149460315704346, 'depth': 0} 2025-03-31 00:47:36 [reviews] INFO: Scraped item: {'review': 'the rice noodles in pho were very thick ', 'review_id': 291716378, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415} 2025-03-31 00:47:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18575415&page=1> {'review': 'the rice noodles in pho were very thick ', 'review_id': 291716378, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415} 2025-03-31 00:47:36 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291688466, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415} 2025-03-31 00:47:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18575415&page=1> {'review': '', 'review_id': 291688466, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415} 2025-03-31 00:47:36 [reviews] INFO: Scraped item: {'review': 'Lovely', 'review_id': 291344054, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415} 2025-03-31 00:47:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18575415&page=1> {'review': 'Lovely', 'review_id': 291344054, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415} 2025-03-31 00:47:36 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291116719, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415} 2025-03-31 00:47:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18575415&page=1> {'review': '', 'review_id': 291116719, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415} 2025-03-31 00:47:36 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291004385, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415} 2025-03-31 00:47:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18575415&page=1> {'review': '', 'review_id': 291004385, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415} 2025-03-31 00:47:38 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:47:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:47:43 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382005, 'download_latency': 0.7273998260498047, 'depth': 0} 2025-03-31 00:47:43 [reviews] INFO: Scraped item: {'review': 'Brilliant food and ambience', 'review_id': 291162532, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108} 2025-03-31 00:47:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18577108&page=1> {'review': 'Brilliant food and ambience', 'review_id': 291162532, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108} 2025-03-31 00:47:43 [reviews] INFO: Scraped item: {'review': 'An exciting salad, but chopped up too much, small black box presentation and dressing can be separate too much in this case!', 'review_id': 291128677, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108} 2025-03-31 00:47:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18577108&page=1> {'review': 'An exciting salad, but chopped up too much, small black box presentation and dressing can be separate too much in this case!', 'review_id': 291128677, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108} 2025-03-31 00:47:43 [reviews] INFO: Scraped item: {'review': "Abhijeet's service was on time and dish recommendation was good", 'review_id': 291005570, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-29', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108} 2025-03-31 00:47:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18577108&page=1> {'review': "Abhijeet's service was on time and dish recommendation was good", 'review_id': 291005570, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-29', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108} 2025-03-31 00:47:43 [reviews] INFO: Scraped item: {'review': "worst food I don't like it and price is also very high according to food", 'review_id': 290849010, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108} 2025-03-31 00:47:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18577108&page=1> {'review': "worst food I don't like it and price is also very high according to food", 'review_id': 290849010, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108} 2025-03-31 00:47:43 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290573627, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-28', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108} 2025-03-31 00:47:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18577108&page=1> {'review': '', 'review_id': 290573627, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-28', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108} 2025-03-31 00:47:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:47:46 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382009, 'download_latency': 0.6872658729553223, 'depth': 0} 2025-03-31 00:47:46 [reviews] INFO: Scraped item: {'review': 'Good quantity & quality. Garam masala was a little overpowering but not too much. ', 'review_id': 291164122, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428} 2025-03-31 00:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582428&page=1> {'review': 'Good quantity & quality. Garam masala was a little overpowering but not too much. ', 'review_id': 291164122, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428} 2025-03-31 00:47:46 [reviews] INFO: Scraped item: {'review': 'There is no chicken there are only 4 pieces of chicken, we ordered for 1 kilo biryani with 4 pieces how can this even make sense', 'review_id': 290804626, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428} 2025-03-31 00:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582428&page=1> {'review': 'There is no chicken there are only 4 pieces of chicken, we ordered for 1 kilo biryani with 4 pieces how can this even make sense', 'review_id': 290804626, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428} 2025-03-31 00:47:46 [reviews] INFO: Scraped item: {'review': "the chicken used was very smelly.. seemed stale not fresh. very disappointed in bbk for such bad quality. don't give offers if it's a way to pass off stale ingredients. not ordering again.", 'review_id': 290701438, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428} 2025-03-31 00:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582428&page=1> {'review': "the chicken used was very smelly.. seemed stale not fresh. very disappointed in bbk for such bad quality. don't give offers if it's a way to pass off stale ingredients. not ordering again.", 'review_id': 290701438, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428} 2025-03-31 00:47:46 [reviews] INFO: Scraped item: {'review': 'Horrible experience. Ordered Haleem. Got an oily curry. Never ordering again.', 'review_id': 290659579, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428} 2025-03-31 00:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582428&page=1> {'review': 'Horrible experience. Ordered Haleem. Got an oily curry. Never ordering again.', 'review_id': 290659579, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428} 2025-03-31 00:47:46 [reviews] INFO: Scraped item: {'review': 'great taste', 'review_id': 289955012, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428} 2025-03-31 00:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582428&page=1> {'review': 'great taste', 'review_id': 289955012, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428} 2025-03-31 00:47:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:47:48 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382012, 'download_latency': 0.7723541259765625, 'depth': 0} 2025-03-31 00:47:48 [reviews] INFO: Scraped item: {'review': 'Biryani was use less called for 6 person no have ate it, chicken was smelly rice were dry never order from here. Disappointed', 'review_id': 291187433, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431} 2025-03-31 00:47:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582431&page=1> {'review': 'Biryani was use less called for 6 person no have ate it, chicken was smelly rice were dry never order from here. Disappointed', 'review_id': 291187433, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431} 2025-03-31 00:47:48 [reviews] INFO: Scraped item: {'review': "Rice used were not basmati or biryani rice. they were broken, maybe overcooked. wasted my money and wasted my time. that's what I felt. too high prices for common rice you can get on any local shop. they are charging high prices just because of packaging and matka. thats it. ", 'review_id': 291048398, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431} 2025-03-31 00:47:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582431&page=1> {'review': "Rice used were not basmati or biryani rice. they were broken, maybe overcooked. wasted my money and wasted my time. that's what I felt. too high prices for common rice you can get on any local shop. they are charging high prices just because of packaging and matka. thats it. ", 'review_id': 291048398, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431} 2025-03-31 00:47:48 [reviews] INFO: Scraped item: {'review': 'I had lot of expectations from them but the biryani was very bad. Rice was overcooked and not vegetables were there. So disappointed from biryani by kilo', 'review_id': 290710617, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431} 2025-03-31 00:47:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582431&page=1> {'review': 'I had lot of expectations from them but the biryani was very bad. Rice was overcooked and not vegetables were there. So disappointed from biryani by kilo', 'review_id': 290710617, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431} 2025-03-31 00:47:48 [reviews] INFO: Scraped item: {'review': 'I have received a broken container ', 'review_id': 290362282, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431} 2025-03-31 00:47:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582431&page=1> {'review': 'I have received a broken container ', 'review_id': 290362282, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431} 2025-03-31 00:47:48 [reviews] INFO: Scraped item: {'review': 'Requested for non spicy briani but it was spicy ...', 'review_id': 289676280, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431} 2025-03-31 00:47:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582431&page=1> {'review': 'Requested for non spicy briani but it was spicy ...', 'review_id': 289676280, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431} 2025-03-31 00:47:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:47:53 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 86, 'brand_name': 'Health Juice Centre', 'city': 'Mumbai', 'sub_zone': 'Parel', 'platform': 'zomato', 'res_id': 18596459, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382016, 'download_latency': 0.7898905277252197, 'depth': 0} 2025-03-31 00:47:53 [reviews] INFO: Scraped item: {'review': 'please package ko plastic bag mein pack Karen..
Ice ke water se Paper bag phat jaata hain.
use only plastic carry bag....', 'review_id': 291726503, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 86, 'brand_name': 'Health Juice Centre', 'city': 'Mumbai', 'sub_zone': 'Parel', 'platform': 'zomato', 'res_id': 18596459} 2025-03-31 00:47:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18596459&page=1> {'review': 'please package ko plastic bag mein pack Karen..
Ice ke water se Paper bag phat jaata hain.
use only plastic carry bag....', 'review_id': 291726503, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 86, 'brand_name': 'Health Juice Centre', 'city': 'Mumbai', 'sub_zone': 'Parel', 'platform': 'zomato', 'res_id': 18596459} 2025-03-31 00:47:53 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291214181, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 86, 'brand_name': 'Health Juice Centre', 'city': 'Mumbai', 'sub_zone': 'Parel', 'platform': 'zomato', 'res_id': 18596459} 2025-03-31 00:47:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18596459&page=1> {'review': '', 'review_id': 291214181, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 86, 'brand_name': 'Health Juice Centre', 'city': 'Mumbai', 'sub_zone': 'Parel', 'platform': 'zomato', 'res_id': 18596459} 2025-03-31 00:47:53 [reviews] INFO: Scraped item: {'review': 'not good taste ', 'review_id': 291040123, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 86, 'brand_name': 'Health Juice Centre', 'city': 'Mumbai', 'sub_zone': 'Parel', 'platform': 'zomato', 'res_id': 18596459} 2025-03-31 00:47:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18596459&page=1> {'review': 'not good taste ', 'review_id': 291040123, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 86, 'brand_name': 'Health Juice Centre', 'city': 'Mumbai', 'sub_zone': 'Parel', 'platform': 'zomato', 'res_id': 18596459} 2025-03-31 00:47:53 [reviews] INFO: Scraped item: {'review': 'since the order was delayed the sandwich had become soggy', 'review_id': 290673543, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 86, 'brand_name': 'Health Juice Centre', 'city': 'Mumbai', 'sub_zone': 'Parel', 'platform': 'zomato', 'res_id': 18596459} 2025-03-31 00:47:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18596459&page=1> {'review': 'since the order was delayed the sandwich had become soggy', 'review_id': 290673543, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 86, 'brand_name': 'Health Juice Centre', 'city': 'Mumbai', 'sub_zone': 'Parel', 'platform': 'zomato', 'res_id': 18596459} 2025-03-31 00:47:53 [reviews] INFO: Scraped item: {'review': 'there is no cheese', 'review_id': 290043142, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 86, 'brand_name': 'Health Juice Centre', 'city': 'Mumbai', 'sub_zone': 'Parel', 'platform': 'zomato', 'res_id': 18596459} 2025-03-31 00:47:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18596459&page=1> {'review': 'there is no cheese', 'review_id': 290043142, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 86, 'brand_name': 'Health Juice Centre', 'city': 'Mumbai', 'sub_zone': 'Parel', 'platform': 'zomato', 'res_id': 18596459} 2025-03-31 00:47:55 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:47:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:47:57 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 0, 'brand_name': 'La Veggie', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 18628825, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382024, 'download_latency': 0.6911654472351074, 'depth': 0} 2025-03-31 00:47:57 [reviews] INFO: Stopping for res_id: 18628825 as reviews are older than 7 days. 2025-03-31 00:48:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:48:01 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Defence Colony', 'platform': 'zomato', 'res_id': 18632303, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382026, 'download_latency': 0.7229993343353271, 'depth': 0} 2025-03-31 00:48:01 [reviews] INFO: Scraped item: {'review': 'Quantity is now much less. There was no taste in rice or chicken.', 'review_id': 291187605, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Defence Colony', 'platform': 'zomato', 'res_id': 18632303} 2025-03-31 00:48:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18632303&page=1> {'review': 'Quantity is now much less. There was no taste in rice or chicken.', 'review_id': 291187605, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Defence Colony', 'platform': 'zomato', 'res_id': 18632303} 2025-03-31 00:48:01 [reviews] INFO: Scraped item: {'review': 'Very few chicken pieces, that too small in size compared to usual standards', 'review_id': 291179901, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Defence Colony', 'platform': 'zomato', 'res_id': 18632303} 2025-03-31 00:48:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18632303&page=1> {'review': 'Very few chicken pieces, that too small in size compared to usual standards', 'review_id': 291179901, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Defence Colony', 'platform': 'zomato', 'res_id': 18632303} 2025-03-31 00:48:01 [reviews] INFO: Scraped item: {'review': 'worst ever biryani from behruz', 'review_id': 291034471, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Defence Colony', 'platform': 'zomato', 'res_id': 18632303} 2025-03-31 00:48:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18632303&page=1> {'review': 'worst ever biryani from behruz', 'review_id': 291034471, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Defence Colony', 'platform': 'zomato', 'res_id': 18632303} 2025-03-31 00:48:01 [reviews] INFO: Scraped item: {'review': 'not good ', 'review_id': 291004846, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Defence Colony', 'platform': 'zomato', 'res_id': 18632303} 2025-03-31 00:48:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18632303&page=1> {'review': 'not good ', 'review_id': 291004846, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Defence Colony', 'platform': 'zomato', 'res_id': 18632303} 2025-03-31 00:48:01 [reviews] INFO: Scraped item: {'review': 'non spicy amazing taste ', 'review_id': 290321778, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Defence Colony', 'platform': 'zomato', 'res_id': 18632303} 2025-03-31 00:48:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18632303&page=1> {'review': 'non spicy amazing taste ', 'review_id': 290321778, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Defence Colony', 'platform': 'zomato', 'res_id': 18632303} 2025-03-31 00:48:04 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:48:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:48:11 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:48:15 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:48:19 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:48:22 [scrapy.extensions.logstats] INFO: Crawled 80 pages (at 7 pages/min), scraped 263 items (at 30 items/min) 2025-03-31 00:48:23 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:48:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:48:28 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 49, 'brand_name': 'Pa Pa Ya', 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18650200, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382052, 'download_latency': 0.7362184524536133, 'depth': 0} 2025-03-31 00:48:28 [reviews] INFO: Scraped item: {'review': 'Overall the sushis r yummy', 'review_id': 290401110, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-27', 'competitor_id': 49, 'brand_name': 'Pa Pa Ya', 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18650200} 2025-03-31 00:48:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18650200&page=1> {'review': 'Overall the sushis r yummy', 'review_id': 290401110, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-27', 'competitor_id': 49, 'brand_name': 'Pa Pa Ya', 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18650200} 2025-03-31 00:48:28 [reviews] INFO: Stopping for res_id: 18650200 as reviews are older than 7 days. 2025-03-31 00:48:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:48:33 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382056, 'download_latency': 0.68961501121521, 'depth': 0} 2025-03-31 00:48:33 [reviews] INFO: Scraped item: {'review': 'I have ordered mutton biryani for someone else and I am glad that they liked ', 'review_id': 291765998, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316} 2025-03-31 00:48:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18658316&page=1> {'review': 'I have ordered mutton biryani for someone else and I am glad that they liked ', 'review_id': 291765998, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316} 2025-03-31 00:48:33 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291765215, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316} 2025-03-31 00:48:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18658316&page=1> {'review': '', 'review_id': 291765215, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316} 2025-03-31 00:48:33 [reviews] INFO: Scraped item: {'review': 'I ordered 2 half kg biryani but I got only 1 piece of chicken in each half. This is so unsatisfactory from Biriyani By Kilo. ', 'review_id': 290936887, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316} 2025-03-31 00:48:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18658316&page=1> {'review': 'I ordered 2 half kg biryani but I got only 1 piece of chicken in each half. This is so unsatisfactory from Biriyani By Kilo. ', 'review_id': 290936887, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316} 2025-03-31 00:48:33 [reviews] INFO: Scraped item: {'review': 'Biryani was too spicy they have used too much garam masala and not at all tasty.', 'review_id': 290907133, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-29', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316} 2025-03-31 00:48:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18658316&page=1> {'review': 'Biryani was too spicy they have used too much garam masala and not at all tasty.', 'review_id': 290907133, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-29', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316} 2025-03-31 00:48:33 [reviews] INFO: Scraped item: {'review': 'Avni given us best service there', 'review_id': 290782221, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316} 2025-03-31 00:48:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18658316&page=1> {'review': 'Avni given us best service there', 'review_id': 290782221, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316} 2025-03-31 00:48:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:48:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:48:40 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382063, 'download_latency': 0.6835970878601074, 'depth': 0} 2025-03-31 00:48:40 [reviews] INFO: Scraped item: {'review': 'nice food', 'review_id': 291774245, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842} 2025-03-31 00:48:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18665842&page=1> {'review': 'nice food', 'review_id': 291774245, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842} 2025-03-31 00:48:40 [reviews] INFO: Scraped item: {'review': "Very pathetic taste and very less quantity. Don't order from there.", 'review_id': 291732724, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842} 2025-03-31 00:48:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18665842&page=1> {'review': "Very pathetic taste and very less quantity. Don't order from there.", 'review_id': 291732724, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842} 2025-03-31 00:48:40 [reviews] INFO: Scraped item: {'review': 'taste is too good. I want little increase in quantity as the food is tasty.', 'review_id': 291567670, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842} 2025-03-31 00:48:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18665842&page=1> {'review': 'taste is too good. I want little increase in quantity as the food is tasty.', 'review_id': 291567670, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842} 2025-03-31 00:48:40 [reviews] INFO: Scraped item: {'review': 'not fresh chilli pakora very bad quality ', 'review_id': 291541427, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842} 2025-03-31 00:48:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18665842&page=1> {'review': 'not fresh chilli pakora very bad quality ', 'review_id': 291541427, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842} 2025-03-31 00:48:40 [reviews] INFO: Scraped item: {'review': 'thanks ๐Ÿ˜Š๐Ÿ‘', 'review_id': 291410569, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842} 2025-03-31 00:48:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18665842&page=1> {'review': 'thanks ๐Ÿ˜Š๐Ÿ‘', 'review_id': 291410569, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842} 2025-03-31 00:48:43 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:48:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:48:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:48:53 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:48:56 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:48:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:49:00 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18669449, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382081, 'download_latency': 0.7226881980895996, 'depth': 0} 2025-03-31 00:49:00 [reviews] INFO: Scraped item: {'review': 'rice was under cooked', 'review_id': 291634998, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18669449} 2025-03-31 00:49:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18669449&page=1> {'review': 'rice was under cooked', 'review_id': 291634998, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18669449} 2025-03-31 00:49:00 [reviews] INFO: Scraped item: {'review': "I am disappointed by the amount of mutton in the biryani. It was like a medium piece was cut into 6 tiny pieces and added to the biryani. That's all there was in the biryani for almost 1000 rs. It tasted below average as well. Zero value for money. ๐Ÿ‘Ž", 'review_id': 291340774, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18669449} 2025-03-31 00:49:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18669449&page=1> {'review': "I am disappointed by the amount of mutton in the biryani. It was like a medium piece was cut into 6 tiny pieces and added to the biryani. That's all there was in the biryani for almost 1000 rs. It tasted below average as well. Zero value for money. ๐Ÿ‘Ž", 'review_id': 291340774, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18669449} 2025-03-31 00:49:00 [reviews] INFO: Scraped item: {'review': 'There were no chicken pices in the biryani', 'review_id': 290792461, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18669449} 2025-03-31 00:49:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18669449&page=1> {'review': 'There were no chicken pices in the biryani', 'review_id': 290792461, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18669449} 2025-03-31 00:49:00 [reviews] INFO: Scraped item: {'review': 'missing the added extra item .. already paid for the that item and still not refunded .. very disappointing', 'review_id': 289749959, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18669449} 2025-03-31 00:49:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18669449&page=1> {'review': 'missing the added extra item .. already paid for the that item and still not refunded .. very disappointing', 'review_id': 289749959, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18669449} 2025-03-31 00:49:00 [reviews] INFO: Stopping for res_id: 18669449 as reviews are older than 7 days. 2025-03-31 00:49:03 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:49:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:49:12 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:49:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:49:19 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:49:22 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:49:22 [scrapy.extensions.logstats] INFO: Crawled 84 pages (at 4 pages/min), scraped 278 items (at 15 items/min) 2025-03-31 00:49:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:49:25 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382109, 'download_latency': 0.6996626853942871, 'depth': 0} 2025-03-31 00:49:25 [reviews] INFO: Scraped item: {'review': 'there was no leg piece and there were only rbs and bones no meat at all. Great malpractice during the month of Ramadan. And the price so high. ', 'review_id': 291580451, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791} 2025-03-31 00:49:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18670791&page=1> {'review': 'there was no leg piece and there were only rbs and bones no meat at all. Great malpractice during the month of Ramadan. And the price so high. ', 'review_id': 291580451, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791} 2025-03-31 00:49:25 [reviews] INFO: Scraped item: {'review': 'Not gud', 'review_id': 291373378, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791} 2025-03-31 00:49:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18670791&page=1> {'review': 'Not gud', 'review_id': 291373378, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791} 2025-03-31 00:49:25 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290934048, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791} 2025-03-31 00:49:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18670791&page=1> {'review': '', 'review_id': 290934048, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791} 2025-03-31 00:49:25 [reviews] INFO: Scraped item: {'review': 'pura jala hu bheje hai very bad niche se pura black hai ', 'review_id': 290891426, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791} 2025-03-31 00:49:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18670791&page=1> {'review': 'pura jala hu bheje hai very bad niche se pura black hai ', 'review_id': 290891426, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791} 2025-03-31 00:49:25 [reviews] INFO: Scraped item: {'review': 'tandoori was having an odd taste to it', 'review_id': 290787724, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791} 2025-03-31 00:49:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18670791&page=1> {'review': 'tandoori was having an odd taste to it', 'review_id': 290787724, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791} 2025-03-31 00:49:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:49:28 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382113, 'download_latency': 0.7883462905883789, 'depth': 0} 2025-03-31 00:49:28 [reviews] INFO: Scraped item: {'review': 'One pack gazar halwa was hot and fresh and the other was cold and not fresh', 'review_id': 291758132, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928} 2025-03-31 00:49:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18687928&page=1> {'review': 'One pack gazar halwa was hot and fresh and the other was cold and not fresh', 'review_id': 291758132, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928} 2025-03-31 00:49:28 [reviews] INFO: Scraped item: {'review': 'excellent โฃ๏ธ', 'review_id': 291375915, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928} 2025-03-31 00:49:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18687928&page=1> {'review': 'excellent โฃ๏ธ', 'review_id': 291375915, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928} 2025-03-31 00:49:28 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291191235, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928} 2025-03-31 00:49:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18687928&page=1> {'review': '', 'review_id': 291191235, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928} 2025-03-31 00:49:28 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291030265, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928} 2025-03-31 00:49:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18687928&page=1> {'review': '', 'review_id': 291030265, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928} 2025-03-31 00:49:28 [reviews] INFO: Scraped item: {'review': 'Quantity is very less as compared to the price. ', 'review_id': 290121120, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928} 2025-03-31 00:49:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18687928&page=1> {'review': 'Quantity is very less as compared to the price. ', 'review_id': 290121120, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928} 2025-03-31 00:49:31 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:49:35 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:49:39 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:49:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:49:45 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:49:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:49:53 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:49:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:50:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:50:03 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:50:08 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:50:12 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:50:15 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:50:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:50:21 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 18729345, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382162, 'download_latency': 2.2852513790130615, 'depth': 0} 2025-03-31 00:50:21 [reviews] INFO: Scraped item: {'review': 'toomany solid things in soft haleem.. really bad', 'review_id': 290643769, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 18729345} 2025-03-31 00:50:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18729345&page=1> {'review': 'toomany solid things in soft haleem.. really bad', 'review_id': 290643769, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 18729345} 2025-03-31 00:50:21 [reviews] INFO: Scraped item: {'review': 'very less quantity, quality not up to the marks', 'review_id': 290160536, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 18729345} 2025-03-31 00:50:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18729345&page=1> {'review': 'very less quantity, quality not up to the marks', 'review_id': 290160536, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 18729345} 2025-03-31 00:50:21 [reviews] INFO: Stopping for res_id: 18729345 as reviews are older than 7 days. 2025-03-31 00:50:22 [scrapy.extensions.logstats] INFO: Crawled 87 pages (at 3 pages/min), scraped 290 items (at 12 items/min) 2025-03-31 00:50:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:50:24 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai ', 'sub_zone': 'Palladium Mall, Lower Parel', 'platform': 'zomato', 'res_id': 18733959, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382165, 'download_latency': 1.0420310497283936, 'depth': 0} 2025-03-31 00:50:24 [reviews] INFO: Scraped item: {'review': 'ordered smthg else and received a diff order', 'review_id': 291746246, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai ', 'sub_zone': 'Palladium Mall, Lower Parel', 'platform': 'zomato', 'res_id': 18733959} 2025-03-31 00:50:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18733959&page=1> {'review': 'ordered smthg else and received a diff order', 'review_id': 291746246, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai ', 'sub_zone': 'Palladium Mall, Lower Parel', 'platform': 'zomato', 'res_id': 18733959} 2025-03-31 00:50:24 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290292251, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai ', 'sub_zone': 'Palladium Mall, Lower Parel', 'platform': 'zomato', 'res_id': 18733959} 2025-03-31 00:50:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18733959&page=1> {'review': '', 'review_id': 290292251, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai ', 'sub_zone': 'Palladium Mall, Lower Parel', 'platform': 'zomato', 'res_id': 18733959} 2025-03-31 00:50:24 [reviews] INFO: Stopping for res_id: 18733959 as reviews are older than 7 days. 2025-03-31 00:50:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:50:31 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:50:33 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:50:38 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:50:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:50:45 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:50:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:50:52 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:50:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:50:59 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:51:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:51:06 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:51:10 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:51:14 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:51:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:51:20 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382221, 'download_latency': 1.8127758502960205, 'depth': 0} 2025-03-31 00:51:20 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291486895, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687} 2025-03-31 00:51:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18735687&page=1> {'review': '', 'review_id': 291486895, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687} 2025-03-31 00:51:20 [reviews] INFO: Scraped item: {'review': 'Loved the private dining room. ', 'review_id': 291416012, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687} 2025-03-31 00:51:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18735687&page=1> {'review': 'Loved the private dining room. ', 'review_id': 291416012, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687} 2025-03-31 00:51:20 [reviews] INFO: Scraped item: {'review': 'service is very slow. more importantly no one comes to write the orders for quite some time even in less crowded situation. Food was good.', 'review_id': 291275272, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687} 2025-03-31 00:51:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18735687&page=1> {'review': 'service is very slow. more importantly no one comes to write the orders for quite some time even in less crowded situation. Food was good.', 'review_id': 291275272, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687} 2025-03-31 00:51:20 [reviews] INFO: Scraped item: {'review': 'Bhai Schezwan Chutney Ke Bhaga Tumne Zomato Chutney Dalaal test bhi accha nhi h', 'review_id': 291036489, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687} 2025-03-31 00:51:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18735687&page=1> {'review': 'Bhai Schezwan Chutney Ke Bhaga Tumne Zomato Chutney Dalaal test bhi accha nhi h', 'review_id': 291036489, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687} 2025-03-31 00:51:20 [reviews] INFO: Scraped item: {'review': 'Rice was dry looks like it was made day before yesterday and was heated and delivered', 'review_id': 291003175, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687} 2025-03-31 00:51:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18735687&page=1> {'review': 'Rice was dry looks like it was made day before yesterday and was heated and delivered', 'review_id': 291003175, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687} 2025-03-31 00:51:22 [scrapy.extensions.logstats] INFO: Crawled 89 pages (at 2 pages/min), scraped 297 items (at 7 items/min) 2025-03-31 00:51:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:51:23 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 77, 'brand_name': 'Biggies Burger', 'city': 'Bangalore', 'sub_zone': 'Church Street', 'platform': 'zomato', 'res_id': 18738761, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382224, 'download_latency': 0.8656907081604004, 'depth': 0} 2025-03-31 00:51:23 [reviews] INFO: Scraped item: {'review': 'i ordered Schezwan one but I got bbq one pls check and deliver ', 'review_id': 290672433, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 77, 'brand_name': 'Biggies Burger', 'city': 'Bangalore', 'sub_zone': 'Church Street', 'platform': 'zomato', 'res_id': 18738761} 2025-03-31 00:51:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18738761&page=1> {'review': 'i ordered Schezwan one but I got bbq one pls check and deliver ', 'review_id': 290672433, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 77, 'brand_name': 'Biggies Burger', 'city': 'Bangalore', 'sub_zone': 'Church Street', 'platform': 'zomato', 'res_id': 18738761} 2025-03-31 00:51:23 [reviews] INFO: Scraped item: {'review': 'Nice place with good food and decent ambience.
', 'review_id': 290509848, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-27', 'competitor_id': 77, 'brand_name': 'Biggies Burger', 'city': 'Bangalore', 'sub_zone': 'Church Street', 'platform': 'zomato', 'res_id': 18738761} 2025-03-31 00:51:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18738761&page=1> {'review': 'Nice place with good food and decent ambience.
', 'review_id': 290509848, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-27', 'competitor_id': 77, 'brand_name': 'Biggies Burger', 'city': 'Bangalore', 'sub_zone': 'Church Street', 'platform': 'zomato', 'res_id': 18738761} 2025-03-31 00:51:23 [reviews] INFO: Stopping for res_id: 18738761 as reviews are older than 7 days. 2025-03-31 00:51:25 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:51:30 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:51:33 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:51:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:51:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:51:45 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:51:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:51:52 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:51:55 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:51:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:52:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:52:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:52:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:52:12 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382270, 'download_latency': 1.522287130355835, 'depth': 0} 2025-03-31 00:52:12 [reviews] INFO: Scraped item: {'review': 'Worst Quality....
waste of Money ', 'review_id': 291337527, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991} 2025-03-31 00:52:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18746991&page=1> {'review': 'Worst Quality....
waste of Money ', 'review_id': 291337527, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991} 2025-03-31 00:52:12 [reviews] INFO: Scraped item: {'review': 'The matki was broken and Phirni was not taped so it was spilled.', 'review_id': 291167507, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991} 2025-03-31 00:52:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18746991&page=1> {'review': 'The matki was broken and Phirni was not taped so it was spilled.', 'review_id': 291167507, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991} 2025-03-31 00:52:12 [reviews] INFO: Scraped item: {'review': "Spices were more as compared to rice served. You provide less rice so there is no point of adding too much spices it spoiled the balance. It was just about pots and nothing else. I won't call it biryani. It was chicken rice with loads of spice", 'review_id': 290680731, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991} 2025-03-31 00:52:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18746991&page=1> {'review': "Spices were more as compared to rice served. You provide less rice so there is no point of adding too much spices it spoiled the balance. It was just about pots and nothing else. I won't call it biryani. It was chicken rice with loads of spice", 'review_id': 290680731, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991} 2025-03-31 00:52:12 [reviews] INFO: Scraped item: {'review': 'bad in taste send curd instant of gravy ', 'review_id': 290674968, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991} 2025-03-31 00:52:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18746991&page=1> {'review': 'bad in taste send curd instant of gravy ', 'review_id': 290674968, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991} 2025-03-31 00:52:12 [reviews] INFO: Scraped item: {'review': 'very poor quality ', 'review_id': 290313423, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991} 2025-03-31 00:52:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18746991&page=1> {'review': 'very poor quality ', 'review_id': 290313423, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991} 2025-03-31 00:52:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:52:15 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382275, 'download_latency': 0.784153938293457, 'depth': 0} 2025-03-31 00:52:15 [reviews] INFO: Scraped item: {'review': 'เคธเฅ‹เคกเคพ เคฌเคนเฅเคค เคกเคพเคฒเคคเฅ‡ เคนเฅ‹ เค†เคช ', 'review_id': 291409773, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110} 2025-03-31 00:52:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18780110&page=1> {'review': 'เคธเฅ‹เคกเคพ เคฌเคนเฅเคค เคกเคพเคฒเคคเฅ‡ เคนเฅ‹ เค†เคช ', 'review_id': 291409773, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110} 2025-03-31 00:52:15 [reviews] INFO: Scraped item: {'review': 'extra pay karke extra succe order Kiya but careless delivery ', 'review_id': 291374701, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110} 2025-03-31 00:52:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18780110&page=1> {'review': 'extra pay karke extra succe order Kiya but careless delivery ', 'review_id': 291374701, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110} 2025-03-31 00:52:15 [reviews] INFO: Scraped item: {'review': 'Very very salty dish both of them', 'review_id': 291159735, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110} 2025-03-31 00:52:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18780110&page=1> {'review': 'Very very salty dish both of them', 'review_id': 291159735, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110} 2025-03-31 00:52:15 [reviews] INFO: Scraped item: {'review': 'god quality of food', 'review_id': 290788816, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110} 2025-03-31 00:52:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18780110&page=1> {'review': 'god quality of food', 'review_id': 290788816, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110} 2025-03-31 00:52:15 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290679900, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110} 2025-03-31 00:52:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18780110&page=1> {'review': '', 'review_id': 290679900, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110} 2025-03-31 00:52:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:52:20 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Navi Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 18789443, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382280, 'download_latency': 2.2639214992523193, 'depth': 0} 2025-03-31 00:52:20 [reviews] INFO: Scraped item: {'review': 'the order was super late ', 'review_id': 291386963, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Navi Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 18789443} 2025-03-31 00:52:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18789443&page=1> {'review': 'the order was super late ', 'review_id': 291386963, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Navi Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 18789443} 2025-03-31 00:52:20 [reviews] INFO: Scraped item: {'review': 'charged Me twice for single full noodles ', 'review_id': 291040755, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Navi Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 18789443} 2025-03-31 00:52:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18789443&page=1> {'review': 'charged Me twice for single full noodles ', 'review_id': 291040755, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Navi Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 18789443} 2025-03-31 00:52:20 [reviews] INFO: Scraped item: {'review': 'Worst delivery', 'review_id': 290618804, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Navi Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 18789443} 2025-03-31 00:52:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18789443&page=1> {'review': 'Worst delivery', 'review_id': 290618804, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Navi Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 18789443} 2025-03-31 00:52:20 [reviews] INFO: Stopping for res_id: 18789443 as reviews are older than 7 days. 2025-03-31 00:52:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:52:22 [scrapy.extensions.logstats] INFO: Crawled 93 pages (at 4 pages/min), scraped 312 items (at 15 items/min) 2025-03-31 00:52:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-31 00:52:24 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-31 00:52:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:52:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:52:30 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:52:34 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:52:37 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:52:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:52:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:52:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:52:53 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:52:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:53:01 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:53:06 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:53:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:53:10 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 94, 'brand_name': 'Blossom - The Fusion Spot', 'city': 'Mumbai', 'sub_zone': 'Ghatkopar', 'platform': 'zomato', 'res_id': 18797180, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382333, 'download_latency': 1.5631589889526367, 'depth': 0} 2025-03-31 00:53:10 [reviews] INFO: Stopping for res_id: 18797180 as reviews are older than 7 days. 2025-03-31 00:53:12 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:53:17 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:53:21 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:53:22 [scrapy.extensions.logstats] INFO: Crawled 94 pages (at 1 pages/min), scraped 312 items (at 0 items/min) 2025-03-31 00:53:26 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:53:30 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:53:33 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:53:37 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:53:41 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:53:45 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:53:49 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:53:51 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:53:54 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:53:59 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:54:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:54:03 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382382, 'download_latency': 2.7665798664093018, 'depth': 0} 2025-03-31 00:54:03 [reviews] INFO: Scraped item: {'review': 'Food quality not good', 'review_id': 291198257, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648} 2025-03-31 00:54:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18806648&page=1> {'review': 'Food quality not good', 'review_id': 291198257, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648} 2025-03-31 00:54:03 [reviews] INFO: Scraped item: {'review': 'Rice quality is very bad taste like cheap biryani thela biryani better than it taste less biryani', 'review_id': 290480665, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648} 2025-03-31 00:54:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18806648&page=1> {'review': 'Rice quality is very bad taste like cheap biryani thela biryani better than it taste less biryani', 'review_id': 290480665, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648} 2025-03-31 00:54:03 [reviews] INFO: Scraped item: {'review': 'poor quantity ', 'review_id': 289820111, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648} 2025-03-31 00:54:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18806648&page=1> {'review': 'poor quantity ', 'review_id': 289820111, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648} 2025-03-31 00:54:03 [reviews] INFO: Stopping for res_id: 18806648 as reviews are older than 7 days. 2025-03-31 00:54:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:54:05 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382386, 'download_latency': 1.967886209487915, 'depth': 0} 2025-03-31 00:54:05 [reviews] INFO: Scraped item: {'review': 'awesome food ๐Ÿ˜‹', 'review_id': 291775635, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839} 2025-03-31 00:54:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18852839&page=1> {'review': 'awesome food ๐Ÿ˜‹', 'review_id': 291775635, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839} 2025-03-31 00:54:05 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291764947, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839} 2025-03-31 00:54:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18852839&page=1> {'review': '', 'review_id': 291764947, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839} 2025-03-31 00:54:05 [reviews] INFO: Scraped item: {'review': 'Worst biryani!', 'review_id': 291735531, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839} 2025-03-31 00:54:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18852839&page=1> {'review': 'Worst biryani!', 'review_id': 291735531, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839} 2025-03-31 00:54:05 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291601137, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839} 2025-03-31 00:54:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18852839&page=1> {'review': '', 'review_id': 291601137, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839} 2025-03-31 00:54:05 [reviews] INFO: Scraped item: {'review': 'too much salt and spicy ', 'review_id': 291416596, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839} 2025-03-31 00:54:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18852839&page=1> {'review': 'too much salt and spicy ', 'review_id': 291416596, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839} 2025-03-31 00:54:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:54:09 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 92, 'brand_name': 'R Steam Hot', 'city': 'Mumbai', 'sub_zone': 'Ghatkopar', 'platform': 'zomato', 'res_id': 18857031, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382390, 'download_latency': 1.1601588726043701, 'depth': 0} 2025-03-31 00:54:09 [reviews] INFO: Scraped item: {'review': 'Taste not same as it use to be before.', 'review_id': 291407299, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 92, 'brand_name': 'R Steam Hot', 'city': 'Mumbai', 'sub_zone': 'Ghatkopar', 'platform': 'zomato', 'res_id': 18857031} 2025-03-31 00:54:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18857031&page=1> {'review': 'Taste not same as it use to be before.', 'review_id': 291407299, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 92, 'brand_name': 'R Steam Hot', 'city': 'Mumbai', 'sub_zone': 'Ghatkopar', 'platform': 'zomato', 'res_id': 18857031} 2025-03-31 00:54:09 [reviews] INFO: Scraped item: {'review': 'Take too much time n pizza was ice Cold ', 'review_id': 290278770, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 92, 'brand_name': 'R Steam Hot', 'city': 'Mumbai', 'sub_zone': 'Ghatkopar', 'platform': 'zomato', 'res_id': 18857031} 2025-03-31 00:54:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18857031&page=1> {'review': 'Take too much time n pizza was ice Cold ', 'review_id': 290278770, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 92, 'brand_name': 'R Steam Hot', 'city': 'Mumbai', 'sub_zone': 'Ghatkopar', 'platform': 'zomato', 'res_id': 18857031} 2025-03-31 00:54:09 [reviews] INFO: Stopping for res_id: 18857031 as reviews are older than 7 days. 2025-03-31 00:54:12 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:54:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:54:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:54:22 [scrapy.extensions.logstats] INFO: Crawled 97 pages (at 3 pages/min), scraped 322 items (at 10 items/min) 2025-03-31 00:54:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:54:25 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:54:30 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:54:32 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:54:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:54:37 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 18887194, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382422, 'download_latency': 1.5915467739105225, 'depth': 0} 2025-03-31 00:54:37 [reviews] INFO: Scraped item: {'review': 'chicken Tikka masala only grawy not tested ', 'review_id': 291758556, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 18887194} 2025-03-31 00:54:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18887194&page=1> {'review': 'chicken Tikka masala only grawy not tested ', 'review_id': 291758556, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 18887194} 2025-03-31 00:54:37 [reviews] INFO: Scraped item: {'review': 'This place is a must go to for authentic Butter Chicken! The service, the food quality and quantity and the ambience is worth the visit. The last time I visited was in 2021, and guess what nothing has changed. We were assisted by Suraj for the dining, and he was continuously monitoring our plates and our needs. He also reheated the garlic naan for us without even us having to ask for it. Felt really warm and at home with the attitude he served us with. Also, the staff were so courteous and attentive to serve us.

The butter chicken was so creamy, smooth and cooked with perfection. Unlike most other places, it is not sweet, rather a perfect balance of sweet and spicy. The cheese garlic naan is worth tasting!

I would recommend the restaurant to use a rather branded company like Cello, which Iโ€™ve mostly seen in other restaurants for the melamine or opalware that they use, as the plates looked a bit plasticky.

Overall, the experience is too good. After reading some bad google reviews, I was worried about coming here, but the service, and the food quality proved me wrong. Absolute best.', 'review_id': 291753557, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 18887194} 2025-03-31 00:54:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18887194&page=1> {'review': 'This place is a must go to for authentic Butter Chicken! The service, the food quality and quantity and the ambience is worth the visit. The last time I visited was in 2021, and guess what nothing has changed. We were assisted by Suraj for the dining, and he was continuously monitoring our plates and our needs. He also reheated the garlic naan for us without even us having to ask for it. Felt really warm and at home with the attitude he served us with. Also, the staff were so courteous and attentive to serve us.

The butter chicken was so creamy, smooth and cooked with perfection. Unlike most other places, it is not sweet, rather a perfect balance of sweet and spicy. The cheese garlic naan is worth tasting!

I would recommend the restaurant to use a rather branded company like Cello, which Iโ€™ve mostly seen in other restaurants for the melamine or opalware that they use, as the plates looked a bit plasticky.

Overall, the experience is too good. After reading some bad google reviews, I was worried about coming here, but the service, and the food quality proved me wrong. Absolute best.', 'review_id': 291753557, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 18887194} 2025-03-31 00:54:37 [reviews] INFO: Scraped item: {'review': 'Disgrace in making a mockery of the legendary Haleem. You do not deserve to sell the same ', 'review_id': 291732799, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 18887194} 2025-03-31 00:54:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18887194&page=1> {'review': 'Disgrace in making a mockery of the legendary Haleem. You do not deserve to sell the same ', 'review_id': 291732799, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 18887194} 2025-03-31 00:54:37 [reviews] INFO: Scraped item: {'review': 'Biryani was not fresh ', 'review_id': 291564294, 'rating': '2', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 18887194} 2025-03-31 00:54:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18887194&page=1> {'review': 'Biryani was not fresh ', 'review_id': 291564294, 'rating': '2', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 18887194} 2025-03-31 00:54:37 [reviews] INFO: Scraped item: {'review': 'The chicken was dry', 'review_id': 291510177, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 18887194} 2025-03-31 00:54:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18887194&page=1> {'review': 'The chicken was dry', 'review_id': 291510177, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 18887194} 2025-03-31 00:54:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:54:41 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382425, 'download_latency': 1.1681444644927979, 'depth': 0} 2025-03-31 00:54:41 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291771205, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094} 2025-03-31 00:54:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18934094&page=1> {'review': '', 'review_id': 291771205, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094} 2025-03-31 00:54:41 [reviews] INFO: Scraped item: {'review': 'Great food', 'review_id': 291708388, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094} 2025-03-31 00:54:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18934094&page=1> {'review': 'Great food', 'review_id': 291708388, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094} 2025-03-31 00:54:41 [reviews] INFO: Scraped item: {'review': 'It was good taste of briyani', 'review_id': 291707754, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094} 2025-03-31 00:54:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18934094&page=1> {'review': 'It was good taste of briyani', 'review_id': 291707754, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094} 2025-03-31 00:54:41 [reviews] INFO: Scraped item: {'review': 'very nice and portion size is also good ', 'review_id': 291509265, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094} 2025-03-31 00:54:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18934094&page=1> {'review': 'very nice and portion size is also good ', 'review_id': 291509265, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094} 2025-03-31 00:54:41 [reviews] INFO: Scraped item: {'review': 'Mushrooms are UNCOOKED... worst', 'review_id': 291502432, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094} 2025-03-31 00:54:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18934094&page=1> {'review': 'Mushrooms are UNCOOKED... worst', 'review_id': 291502432, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094} 2025-03-31 00:54:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:54:45 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 71, 'brand_name': "Raju's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18939360, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382430, 'download_latency': 0.9115259647369385, 'depth': 0} 2025-03-31 00:54:45 [reviews] INFO: Stopping for res_id: 18939360 as reviews are older than 7 days. 2025-03-31 00:54:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:54:49 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18997398, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382431, 'download_latency': 1.2287225723266602, 'depth': 0} 2025-03-31 00:54:49 [reviews] ERROR: Error parsing date: an hour ago, error: unsupported type for timedelta hours component: NoneType 2025-03-31 00:54:49 [reviews] INFO: Stopping for res_id: 18997398 due to unrecognized date format: an hour ago. 2025-03-31 00:54:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:54:53 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Castle Mill', 'platform': 'zomato', 'res_id': 19022949, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382435, 'download_latency': 0.9415955543518066, 'depth': 0} 2025-03-31 00:54:53 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291779011, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Castle Mill', 'platform': 'zomato', 'res_id': 19022949} 2025-03-31 00:54:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19022949&page=1> {'review': '', 'review_id': 291779011, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Castle Mill', 'platform': 'zomato', 'res_id': 19022949} 2025-03-31 00:54:53 [reviews] INFO: Scraped item: {'review': 'Pieces of chicken instead of mutton have order mutton Biryani', 'review_id': 291545604, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Castle Mill', 'platform': 'zomato', 'res_id': 19022949} 2025-03-31 00:54:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19022949&page=1> {'review': 'Pieces of chicken instead of mutton have order mutton Biryani', 'review_id': 291545604, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Castle Mill', 'platform': 'zomato', 'res_id': 19022949} 2025-03-31 00:54:53 [reviews] INFO: Scraped item: {'review': "Full of salt and taste was not good and quantity sucks.Good that quality was less because one can't eat it and it's fits in dustbin waste of money", 'review_id': 291517059, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Castle Mill', 'platform': 'zomato', 'res_id': 19022949} 2025-03-31 00:54:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19022949&page=1> {'review': "Full of salt and taste was not good and quantity sucks.Good that quality was less because one can't eat it and it's fits in dustbin waste of money", 'review_id': 291517059, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Castle Mill', 'platform': 'zomato', 'res_id': 19022949} 2025-03-31 00:54:53 [reviews] INFO: Scraped item: {'review': 'thank you for lovely packaging ', 'review_id': 291515683, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Castle Mill', 'platform': 'zomato', 'res_id': 19022949} 2025-03-31 00:54:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19022949&page=1> {'review': 'thank you for lovely packaging ', 'review_id': 291515683, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Castle Mill', 'platform': 'zomato', 'res_id': 19022949} 2025-03-31 00:54:53 [reviews] INFO: Scraped item: {'review': 'taste does not justice the price at all looks like taking more money for the packaging ', 'review_id': 291391208, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Castle Mill', 'platform': 'zomato', 'res_id': 19022949} 2025-03-31 00:54:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19022949&page=1> {'review': 'taste does not justice the price at all looks like taking more money for the packaging ', 'review_id': 291391208, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Castle Mill', 'platform': 'zomato', 'res_id': 19022949} 2025-03-31 00:54:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:54:57 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382439, 'download_latency': 1.1425104141235352, 'depth': 0} 2025-03-31 00:54:57 [reviews] INFO: Scraped item: {'review': 'The rice was half cooked and too oily.The biriyani was too hot especially when it is in a plastic box it harms the food as well.', 'review_id': 291595792, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625} 2025-03-31 00:54:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19104625&page=1> {'review': 'The rice was half cooked and too oily.The biriyani was too hot especially when it is in a plastic box it harms the food as well.', 'review_id': 291595792, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625} 2025-03-31 00:54:57 [reviews] INFO: Scraped item: {'review': 'Tasty...', 'review_id': 291118239, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625} 2025-03-31 00:54:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19104625&page=1> {'review': 'Tasty...', 'review_id': 291118239, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625} 2025-03-31 00:54:57 [reviews] INFO: Scraped item: {'review': 'are you guys dumb? what part of send cutlery was not clear??? ', 'review_id': 290997643, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625} 2025-03-31 00:54:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19104625&page=1> {'review': 'are you guys dumb? what part of send cutlery was not clear??? ', 'review_id': 290997643, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625} 2025-03-31 00:54:57 [reviews] INFO: Scraped item: {'review': 'Butter Chicken biryani is worst biryani only 3 to 4 small piece per box.
Biryani tastes similar with hyderabadi biryani with bone and chicken 65 biryani. I now understand that they use common biryani rice and separately add chicken with it.
only thing is good about Bikkgane is they quite affordable unlike other competators.', 'review_id': 290973379, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625} 2025-03-31 00:54:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19104625&page=1> {'review': 'Butter Chicken biryani is worst biryani only 3 to 4 small piece per box.
Biryani tastes similar with hyderabadi biryani with bone and chicken 65 biryani. I now understand that they use common biryani rice and separately add chicken with it.
only thing is good about Bikkgane is they quite affordable unlike other competators.', 'review_id': 290973379, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625} 2025-03-31 00:54:57 [reviews] INFO: Scraped item: {'review': 'the gulab jamun was very chewy. seemed not fresh', 'review_id': 290806116, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625} 2025-03-31 00:54:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19104625&page=1> {'review': 'the gulab jamun was very chewy. seemed not fresh', 'review_id': 290806116, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625} 2025-03-31 00:55:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:55:01 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382444, 'download_latency': 1.0591588020324707, 'depth': 0} 2025-03-31 00:55:01 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291689263, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928} 2025-03-31 00:55:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19119928&page=1> {'review': '', 'review_id': 291689263, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928} 2025-03-31 00:55:01 [reviews] INFO: Scraped item: {'review': 'The turkey sandwich is suppose to have cheddar cheese , some other white cheese was put Instead. The taste was pathetic', 'review_id': 291602466, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928} 2025-03-31 00:55:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19119928&page=1> {'review': 'The turkey sandwich is suppose to have cheddar cheese , some other white cheese was put Instead. The taste was pathetic', 'review_id': 291602466, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928} 2025-03-31 00:55:01 [reviews] INFO: Scraped item: {'review': 'the sandwich tasted very different, bad quality', 'review_id': 291444475, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928} 2025-03-31 00:55:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19119928&page=1> {'review': 'the sandwich tasted very different, bad quality', 'review_id': 291444475, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928} 2025-03-31 00:55:01 [reviews] INFO: Scraped item: {'review': "The delivery didn't give change back", 'review_id': 290803738, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928} 2025-03-31 00:55:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19119928&page=1> {'review': "The delivery didn't give change back", 'review_id': 290803738, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928} 2025-03-31 00:55:01 [reviews] INFO: Scraped item: {'review': 'ordered flat white..only flat it was. no coffee flavour it had .very disappointed. ', 'review_id': 290734739, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928} 2025-03-31 00:55:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19119928&page=1> {'review': 'ordered flat white..only flat it was. no coffee flavour it had .very disappointed. ', 'review_id': 290734739, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928} 2025-03-31 00:55:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:55:04 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 45, 'brand_name': 'The Shaka Cafe', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19123522, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382446, 'download_latency': 1.0925416946411133, 'depth': 0} 2025-03-31 00:55:04 [reviews] INFO: Scraped item: {'review': 'Good', 'review_id': 291755294, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 45, 'brand_name': 'The Shaka Cafe', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19123522} 2025-03-31 00:55:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19123522&page=1> {'review': 'Good', 'review_id': 291755294, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 45, 'brand_name': 'The Shaka Cafe', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19123522} 2025-03-31 00:55:04 [reviews] INFO: Scraped item: {'review': 'Loved the place and sushi was good could try avacado', 'review_id': 291729978, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 45, 'brand_name': 'The Shaka Cafe', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19123522} 2025-03-31 00:55:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19123522&page=1> {'review': 'Loved the place and sushi was good could try avacado', 'review_id': 291729978, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 45, 'brand_name': 'The Shaka Cafe', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19123522} 2025-03-31 00:55:04 [reviews] INFO: Scraped item: {'review': 'amazing food ambience and service!', 'review_id': 291726190, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 45, 'brand_name': 'The Shaka Cafe', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19123522} 2025-03-31 00:55:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19123522&page=1> {'review': 'amazing food ambience and service!', 'review_id': 291726190, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 45, 'brand_name': 'The Shaka Cafe', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19123522} 2025-03-31 00:55:04 [reviews] INFO: Scraped item: {'review': "I've been to many places in Ahmedabad where there is a fusion menu to attract the local food but I've NEVER comes across a place that does fusion and yet retains the authenticity of a food item.

Standout dishes for me were:

Green Thai Curry and Cheese Chilli Scallion Pot", 'review_id': 291153963, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 45, 'brand_name': 'The Shaka Cafe', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19123522} 2025-03-31 00:55:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19123522&page=1> {'review': "I've been to many places in Ahmedabad where there is a fusion menu to attract the local food but I've NEVER comes across a place that does fusion and yet retains the authenticity of a food item.

Standout dishes for me were:

Green Thai Curry and Cheese Chilli Scallion Pot", 'review_id': 291153963, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 45, 'brand_name': 'The Shaka Cafe', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19123522} 2025-03-31 00:55:04 [reviews] INFO: Scraped item: {'review': 'Good food taste', 'review_id': 291153751, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 45, 'brand_name': 'The Shaka Cafe', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19123522} 2025-03-31 00:55:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19123522&page=1> {'review': 'Good food taste', 'review_id': 291153751, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 45, 'brand_name': 'The Shaka Cafe', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19123522} 2025-03-31 00:55:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:55:11 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:55:15 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:55:19 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:55:22 [scrapy.extensions.logstats] INFO: Crawled 105 pages (at 8 pages/min), scraped 352 items (at 30 items/min) 2025-03-31 00:55:23 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:55:26 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:55:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:55:32 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 38, 'brand_name': 'Lavonne', 'city': 'Bangalore', 'sub_zone': 'St. Marks Road', 'platform': 'zomato', 'res_id': 19142873, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382470, 'download_latency': 1.1117613315582275, 'depth': 0} 2025-03-31 00:55:32 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291039573, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 38, 'brand_name': 'Lavonne', 'city': 'Bangalore', 'sub_zone': 'St. Marks Road', 'platform': 'zomato', 'res_id': 19142873} 2025-03-31 00:55:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19142873&page=1> {'review': '', 'review_id': 291039573, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 38, 'brand_name': 'Lavonne', 'city': 'Bangalore', 'sub_zone': 'St. Marks Road', 'platform': 'zomato', 'res_id': 19142873} 2025-03-31 00:55:32 [reviews] INFO: Stopping for res_id: 19142873 as reviews are older than 7 days. 2025-03-31 00:55:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:55:35 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 95, 'brand_name': 'Mad Over Donuts', 'city': 'Bangalore', 'sub_zone': 'HSR', 'platform': 'zomato', 'res_id': 19155973, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382473, 'download_latency': 1.075056552886963, 'depth': 0} 2025-03-31 00:55:35 [reviews] INFO: Stopping for res_id: 19155973 as reviews are older than 7 days. 2025-03-31 00:55:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:55:39 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382478, 'download_latency': 1.1899878978729248, 'depth': 0} 2025-03-31 00:55:39 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291467513, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838} 2025-03-31 00:55:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19168838&page=1> {'review': '', 'review_id': 291467513, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838} 2025-03-31 00:55:39 [reviews] INFO: Scraped item: {'review': 'Nice experience, yummy food ๏ฟผ', 'review_id': 291368048, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838} 2025-03-31 00:55:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19168838&page=1> {'review': 'Nice experience, yummy food ๏ฟผ', 'review_id': 291368048, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838} 2025-03-31 00:55:39 [reviews] INFO: Scraped item: {'review': 'I just love the way it is cooked and the chicken is so tender and I have ordered this biryani several times. The taste is the same every time.', 'review_id': 290667439, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838} 2025-03-31 00:55:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19168838&page=1> {'review': 'I just love the way it is cooked and the chicken is so tender and I have ordered this biryani several times. The taste is the same every time.', 'review_id': 290667439, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838} 2025-03-31 00:55:39 [reviews] INFO: Scraped item: {'review': 'Good food ๐Ÿ˜‹', 'review_id': 290480682, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838} 2025-03-31 00:55:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19168838&page=1> {'review': 'Good food ๐Ÿ˜‹', 'review_id': 290480682, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838} 2025-03-31 00:55:39 [reviews] INFO: Scraped item: {'review': 'The food is not hot and also looking fresh', 'review_id': 290169419, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838} 2025-03-31 00:55:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19168838&page=1> {'review': 'The food is not hot and also looking fresh', 'review_id': 290169419, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838} 2025-03-31 00:55:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:55:44 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:55:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:55:48 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382489, 'download_latency': 1.2064859867095947, 'depth': 0} 2025-03-31 00:55:48 [reviews] INFO: Scraped item: {'review': 'masala was not good', 'review_id': 291617941, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777} 2025-03-31 00:55:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19180777&page=1> {'review': 'masala was not good', 'review_id': 291617941, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777} 2025-03-31 00:55:48 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291485590, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777} 2025-03-31 00:55:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19180777&page=1> {'review': '', 'review_id': 291485590, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777} 2025-03-31 00:55:48 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291250734, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777} 2025-03-31 00:55:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19180777&page=1> {'review': '', 'review_id': 291250734, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777} 2025-03-31 00:55:48 [reviews] INFO: Scraped item: {'review': 'Coackroach in food', 'review_id': 291208690, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777} 2025-03-31 00:55:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19180777&page=1> {'review': 'Coackroach in food', 'review_id': 291208690, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777} 2025-03-31 00:55:48 [reviews] INFO: Scraped item: {'review': 'Rice was not good, i had ordered paneer biryani but lot of vegetables were there also entire biryani was filled with coriander', 'review_id': 290972965, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777} 2025-03-31 00:55:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19180777&page=1> {'review': 'Rice was not good, i had ordered paneer biryani but lot of vegetables were there also entire biryani was filled with coriander', 'review_id': 290972965, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777} 2025-03-31 00:55:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:55:53 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 19194488, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382493, 'download_latency': 1.0856380462646484, 'depth': 0} 2025-03-31 00:55:53 [reviews] ERROR: Error parsing date: an hour ago, error: unsupported type for timedelta hours component: NoneType 2025-03-31 00:55:53 [reviews] INFO: Stopping for res_id: 19194488 due to unrecognized date format: an hour ago. 2025-03-31 00:55:56 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:56:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:56:04 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:56:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:56:11 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:56:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:56:17 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:56:21 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:56:22 [scrapy.extensions.logstats] INFO: Crawled 110 pages (at 5 pages/min), scraped 363 items (at 11 items/min) 2025-03-31 00:56:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:56:25 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382527, 'download_latency': 0.8783793449401855, 'depth': 0} 2025-03-31 00:56:25 [reviews] INFO: Scraped item: {'review': 'The taste was good but quantity was less', 'review_id': 291662010, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026} 2025-03-31 00:56:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19195026&page=1> {'review': 'The taste was good but quantity was less', 'review_id': 291662010, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026} 2025-03-31 00:56:25 [reviews] INFO: Scraped item: {'review': 'Veg Biryani - Right spice and flavour. I like it that it does not go overboard with the masala. Easily the best in flavour and taste I have had in Mumbai. Paneer 65 - Soft paneer, big chunks, easy on the palate.', 'review_id': 291496298, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026} 2025-03-31 00:56:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19195026&page=1> {'review': 'Veg Biryani - Right spice and flavour. I like it that it does not go overboard with the masala. Easily the best in flavour and taste I have had in Mumbai. Paneer 65 - Soft paneer, big chunks, easy on the palate.', 'review_id': 291496298, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026} 2025-03-31 00:56:25 [reviews] INFO: Scraped item: {'review': 'Never mentioned in which dish what biryani was there. Always mention.', 'review_id': 291168001, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026} 2025-03-31 00:56:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19195026&page=1> {'review': 'Never mentioned in which dish what biryani was there. Always mention.', 'review_id': 291168001, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026} 2025-03-31 00:56:25 [reviews] INFO: Stopping for res_id: 19195026 as reviews are older than 7 days. 2025-03-31 00:56:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:56:30 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'K Star Mall', 'platform': 'zomato', 'res_id': 19205663, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382532, 'download_latency': 1.5305168628692627, 'depth': 0} 2025-03-31 00:56:30 [reviews] INFO: Stopping for res_id: 19205663 as reviews are older than 7 days. 2025-03-31 00:56:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:56:34 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 32, 'brand_name': 'Third Wave Coffee', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19207047, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382535, 'download_latency': 1.087373971939087, 'depth': 0} 2025-03-31 00:56:34 [reviews] INFO: Scraped item: {'review': 'this is definitely not the complete sandwich. i have eaten this at the same cafe multiple times. the bread size is not this', 'review_id': 290460669, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 32, 'brand_name': 'Third Wave Coffee', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19207047} 2025-03-31 00:56:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19207047&page=1> {'review': 'this is definitely not the complete sandwich. i have eaten this at the same cafe multiple times. the bread size is not this', 'review_id': 290460669, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 32, 'brand_name': 'Third Wave Coffee', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19207047} 2025-03-31 00:56:34 [reviews] INFO: Stopping for res_id: 19207047 as reviews are older than 7 days. 2025-03-31 00:56:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:56:37 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 12, 'brand_name': 'Kuai Kitchen', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19247726, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382540, 'download_latency': 0.9573984146118164, 'depth': 0} 2025-03-31 00:56:37 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291705319, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 12, 'brand_name': 'Kuai Kitchen', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19247726} 2025-03-31 00:56:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19247726&page=1> {'review': '', 'review_id': 291705319, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 12, 'brand_name': 'Kuai Kitchen', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19247726} 2025-03-31 00:56:37 [reviews] INFO: Scraped item: {'review': '', 'review_id': 289904287, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 12, 'brand_name': 'Kuai Kitchen', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19247726} 2025-03-31 00:56:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19247726&page=1> {'review': '', 'review_id': 289904287, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 12, 'brand_name': 'Kuai Kitchen', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19247726} 2025-03-31 00:56:37 [reviews] INFO: Stopping for res_id: 19247726 as reviews are older than 7 days. 2025-03-31 00:56:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:56:44 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:56:48 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:56:51 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:56:55 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:56:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:57:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:57:06 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:57:10 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:57:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:57:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:57:22 [scrapy.extensions.logstats] INFO: Crawled 114 pages (at 4 pages/min), scraped 369 items (at 6 items/min) 2025-03-31 00:57:23 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:57:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-31 00:57:23 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-31 00:57:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:57:29 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382586, 'download_latency': 2.507934808731079, 'depth': 0} 2025-03-31 00:57:29 [reviews] INFO: Scraped item: {'review': 'Both the cakes was damaged while delivered. Such cheap and worst experience', 'review_id': 291024628, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266} 2025-03-31 00:57:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19257266&page=1> {'review': 'Both the cakes was damaged while delivered. Such cheap and worst experience', 'review_id': 291024628, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266} 2025-03-31 00:57:29 [reviews] INFO: Scraped item: {'review': 'ordered the vanilla slice with choco hazelnut icing but they send chocolate one ๐Ÿ‘Ž', 'review_id': 290723777, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266} 2025-03-31 00:57:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19257266&page=1> {'review': 'ordered the vanilla slice with choco hazelnut icing but they send chocolate one ๐Ÿ‘Ž', 'review_id': 290723777, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266} 2025-03-31 00:57:29 [reviews] INFO: Scraped item: {'review': 'Tummy upset just after eating', 'review_id': 290302358, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266} 2025-03-31 00:57:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19257266&page=1> {'review': 'Tummy upset just after eating', 'review_id': 290302358, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266} 2025-03-31 00:57:29 [reviews] INFO: Stopping for res_id: 19257266 as reviews are older than 7 days. 2025-03-31 00:57:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:57:32 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 52, 'brand_name': 'The Flaming Bowl', 'city': 'Kolkata', 'sub_zone': 'Bhawanipur', 'platform': 'zomato', 'res_id': 19270163, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382590, 'download_latency': 0.8547077178955078, 'depth': 0} 2025-03-31 00:57:32 [reviews] INFO: Stopping for res_id: 19270163 as reviews are older than 7 days. 2025-03-31 00:57:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:57:36 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 81, 'brand_name': 'Kofuku', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19294645, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382594, 'download_latency': 0.7222166061401367, 'depth': 0} 2025-03-31 00:57:36 [reviews] INFO: Scraped item: {'review': "Salmon was stale I think so it was not fresh and was a bit hard. I ate in the restaurant on Friday it was tender and fresh. But the order wasn't good. I ordered the basa in the past it was very good. Maybe will stick to the basa.", 'review_id': 291440841, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 81, 'brand_name': 'Kofuku', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19294645} 2025-03-31 00:57:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19294645&page=1> {'review': "Salmon was stale I think so it was not fresh and was a bit hard. I ate in the restaurant on Friday it was tender and fresh. But the order wasn't good. I ordered the basa in the past it was very good. Maybe will stick to the basa.", 'review_id': 291440841, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 81, 'brand_name': 'Kofuku', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19294645} 2025-03-31 00:57:36 [reviews] INFO: Stopping for res_id: 19294645 as reviews are older than 7 days. 2025-03-31 00:57:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:57:39 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 19295012, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382597, 'download_latency': 0.8027429580688477, 'depth': 0} 2025-03-31 00:57:39 [reviews] INFO: Scraped item: {'review': 'Taste, quantity and quality is very nice. Hara Bhara kebab was worth ordering. But slightly over priced.', 'review_id': 291013884, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 19295012} 2025-03-31 00:57:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19295012&page=1> {'review': 'Taste, quantity and quality is very nice. Hara Bhara kebab was worth ordering. But slightly over priced.', 'review_id': 291013884, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 19295012} 2025-03-31 00:57:39 [reviews] INFO: Scraped item: {'review': 'No salt tasteless', 'review_id': 290348954, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 19295012} 2025-03-31 00:57:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19295012&page=1> {'review': 'No salt tasteless', 'review_id': 290348954, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 19295012} 2025-03-31 00:57:39 [reviews] INFO: Stopping for res_id: 19295012 as reviews are older than 7 days. 2025-03-31 00:57:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:57:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:57:51 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:57:55 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:57:59 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:58:03 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:58:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:58:11 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:58:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:58:18 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:58:21 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:58:22 [scrapy.extensions.logstats] INFO: Crawled 118 pages (at 4 pages/min), scraped 375 items (at 6 items/min) 2025-03-31 00:58:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:58:26 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 19338435, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382643, 'download_latency': 0.7358450889587402, 'depth': 0} 2025-03-31 00:58:26 [reviews] INFO: Scraped item: {'review': 'nice', 'review_id': 291482626, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 19338435} 2025-03-31 00:58:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19338435&page=1> {'review': 'nice', 'review_id': 291482626, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 19338435} 2025-03-31 00:58:26 [reviews] INFO: Scraped item: {'review': 'Dish not that great', 'review_id': 291093645, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 19338435} 2025-03-31 00:58:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19338435&page=1> {'review': 'Dish not that great', 'review_id': 291093645, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 19338435} 2025-03-31 00:58:26 [reviews] INFO: Scraped item: {'review': "Less quantity.

The elaborate description doesn't match the taste. Absolutely tasteless.", 'review_id': 290912141, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 19338435} 2025-03-31 00:58:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19338435&page=1> {'review': "Less quantity.

The elaborate description doesn't match the taste. Absolutely tasteless.", 'review_id': 290912141, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 19338435} 2025-03-31 00:58:26 [reviews] INFO: Scraped item: {'review': 'good ', 'review_id': 290864773, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 19338435} 2025-03-31 00:58:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19338435&page=1> {'review': 'good ', 'review_id': 290864773, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 19338435} 2025-03-31 00:58:26 [reviews] INFO: Scraped item: {'review': 'Cold food', 'review_id': 290680800, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 19338435} 2025-03-31 00:58:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19338435&page=1> {'review': 'Cold food', 'review_id': 290680800, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 19338435} 2025-03-31 00:58:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:58:30 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 19347326, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382650, 'download_latency': 0.784304141998291, 'depth': 0} 2025-03-31 00:58:30 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290278905, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 19347326} 2025-03-31 00:58:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19347326&page=1> {'review': '', 'review_id': 290278905, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 19347326} 2025-03-31 00:58:30 [reviews] INFO: Stopping for res_id: 19347326 as reviews are older than 7 days. 2025-03-31 00:58:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:58:34 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 98, 'brand_name': 'Nair On Fire', 'city': 'Mumbai', 'sub_zone': 'Mahim', 'platform': 'zomato', 'res_id': 19415717, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382652, 'download_latency': 0.7461957931518555, 'depth': 0} 2025-03-31 00:58:34 [reviews] INFO: Scraped item: {'review': 'Not enough chicken in the Biryani. taste good though', 'review_id': 291252484, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 98, 'brand_name': 'Nair On Fire', 'city': 'Mumbai', 'sub_zone': 'Mahim', 'platform': 'zomato', 'res_id': 19415717} 2025-03-31 00:58:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19415717&page=1> {'review': 'Not enough chicken in the Biryani. taste good though', 'review_id': 291252484, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 98, 'brand_name': 'Nair On Fire', 'city': 'Mumbai', 'sub_zone': 'Mahim', 'platform': 'zomato', 'res_id': 19415717} 2025-03-31 00:58:34 [reviews] INFO: Stopping for res_id: 19415717 as reviews are older than 7 days. 2025-03-31 00:58:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:58:38 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 95, 'brand_name': 'Mad Over Donuts', 'city': 'Bangalore', 'sub_zone': 'Kalyan Nagar', 'platform': 'zomato', 'res_id': 19421527, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382657, 'download_latency': 0.7186100482940674, 'depth': 0} 2025-03-31 00:58:38 [reviews] INFO: Scraped item: {'review': 'I had order few doughnuts with extra price, but did not get them', 'review_id': 291096939, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 95, 'brand_name': 'Mad Over Donuts', 'city': 'Bangalore', 'sub_zone': 'Kalyan Nagar', 'platform': 'zomato', 'res_id': 19421527} 2025-03-31 00:58:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19421527&page=1> {'review': 'I had order few doughnuts with extra price, but did not get them', 'review_id': 291096939, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 95, 'brand_name': 'Mad Over Donuts', 'city': 'Bangalore', 'sub_zone': 'Kalyan Nagar', 'platform': 'zomato', 'res_id': 19421527} 2025-03-31 00:58:38 [reviews] INFO: Stopping for res_id: 19421527 as reviews are older than 7 days. 2025-03-31 00:58:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:58:42 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382659, 'download_latency': 0.6806418895721436, 'depth': 0} 2025-03-31 00:58:42 [reviews] INFO: Scraped item: {'review': 'too much oily

no mutton only haadi it was more of haddi oil briyani ', 'review_id': 291768953, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793} 2025-03-31 00:58:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19470793&page=1> {'review': 'too much oily

no mutton only haadi it was more of haddi oil briyani ', 'review_id': 291768953, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793} 2025-03-31 00:58:42 [reviews] INFO: Scraped item: {'review': 'Unsatisfactory taste', 'review_id': 291724830, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793} 2025-03-31 00:58:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19470793&page=1> {'review': 'Unsatisfactory taste', 'review_id': 291724830, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793} 2025-03-31 00:58:42 [reviews] INFO: Scraped item: {'review': 'rate 340 but quantity below avg.... full masala no rice only curry and little bit rice is there worst experience ever ๐Ÿ™๐Ÿ™๐Ÿ™๐Ÿ™ taste too bad', 'review_id': 291688756, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793} 2025-03-31 00:58:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19470793&page=1> {'review': 'rate 340 but quantity below avg.... full masala no rice only curry and little bit rice is there worst experience ever ๐Ÿ™๐Ÿ™๐Ÿ™๐Ÿ™ taste too bad', 'review_id': 291688756, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793} 2025-03-31 00:58:42 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291605692, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793} 2025-03-31 00:58:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19470793&page=1> {'review': '', 'review_id': 291605692, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793} 2025-03-31 00:58:42 [reviews] INFO: Scraped item: {'review': 'too salty ', 'review_id': 291570558, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793} 2025-03-31 00:58:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19470793&page=1> {'review': 'too salty ', 'review_id': 291570558, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793} 2025-03-31 00:58:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:58:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:58:53 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:58:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:59:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:59:04 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:59:08 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:59:12 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:59:15 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:59:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:59:19 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 99, 'brand_name': 'Banana Leaf', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 19474896, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382698, 'download_latency': 0.6835553646087646, 'depth': 0} 2025-03-31 00:59:19 [reviews] INFO: Scraped item: {'review': 'Ranjan was super helpful! Great food, great experience', 'review_id': 291619932, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 99, 'brand_name': 'Banana Leaf', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 19474896} 2025-03-31 00:59:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19474896&page=1> {'review': 'Ranjan was super helpful! Great food, great experience', 'review_id': 291619932, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 99, 'brand_name': 'Banana Leaf', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 19474896} 2025-03-31 00:59:19 [reviews] INFO: Scraped item: {'review': 'I had a mouth-watering experience. Loved everything I had. I went all crazy by ordering everything unique and it amazed me. A must try for - benne masala dosa, butter garlic Idli and gajar halwa ice-cream.', 'review_id': 290465258, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-27', 'competitor_id': 99, 'brand_name': 'Banana Leaf', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 19474896} 2025-03-31 00:59:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19474896&page=1> {'review': 'I had a mouth-watering experience. Loved everything I had. I went all crazy by ordering everything unique and it amazed me. A must try for - benne masala dosa, butter garlic Idli and gajar halwa ice-cream.', 'review_id': 290465258, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-27', 'competitor_id': 99, 'brand_name': 'Banana Leaf', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 19474896} 2025-03-31 00:59:19 [reviews] INFO: Stopping for res_id: 19474896 as reviews are older than 7 days. 2025-03-31 00:59:22 [scrapy.extensions.logstats] INFO: Crawled 124 pages (at 6 pages/min), scraped 390 items (at 15 items/min) 2025-03-31 00:59:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:59:23 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382702, 'download_latency': 0.7676408290863037, 'depth': 0} 2025-03-31 00:59:23 [reviews] INFO: Scraped item: {'review': 'good taste ', 'review_id': 291750850, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939} 2025-03-31 00:59:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19494939&page=1> {'review': 'good taste ', 'review_id': 291750850, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939} 2025-03-31 00:59:23 [reviews] INFO: Scraped item: {'review': 'Pepper chicken biryani was good , however in the dum chicken biryani chicken was not well cooked and was a bit under.
Chicken kebab was good however a bit too over fried and blackened ', 'review_id': 291655625, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939} 2025-03-31 00:59:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19494939&page=1> {'review': 'Pepper chicken biryani was good , however in the dum chicken biryani chicken was not well cooked and was a bit under.
Chicken kebab was good however a bit too over fried and blackened ', 'review_id': 291655625, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939} 2025-03-31 00:59:23 [reviews] INFO: Scraped item: {'review': "Got to know about this place recently, and it didn't disappoint. I have become a regular. Amazing taste and full of flavours. The restaurant was kind enough to accommodate my request as well. Would definitely recommend it to people looking for authentic and delicious biryani.", 'review_id': 291430513, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939} 2025-03-31 00:59:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19494939&page=1> {'review': "Got to know about this place recently, and it didn't disappoint. I have become a regular. Amazing taste and full of flavours. The restaurant was kind enough to accommodate my request as well. Would definitely recommend it to people looking for authentic and delicious biryani.", 'review_id': 291430513, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939} 2025-03-31 00:59:23 [reviews] INFO: Scraped item: {'review': 'worst', 'review_id': 291005441, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939} 2025-03-31 00:59:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19494939&page=1> {'review': 'worst', 'review_id': 291005441, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939} 2025-03-31 00:59:23 [reviews] INFO: Scraped item: {'review': 'wrong order reached', 'review_id': 290907412, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939} 2025-03-31 00:59:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19494939&page=1> {'review': 'wrong order reached', 'review_id': 290907412, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939} 2025-03-31 00:59:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:59:27 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382706, 'download_latency': 0.8125245571136475, 'depth': 0} 2025-03-31 00:59:27 [reviews] INFO: Scraped item: {'review': 'Excellent Like Always ..I just love biryani blues ', 'review_id': 291761523, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084} 2025-03-31 00:59:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19497084&page=1> {'review': 'Excellent Like Always ..I just love biryani blues ', 'review_id': 291761523, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084} 2025-03-31 00:59:27 [reviews] INFO: Scraped item: {'review': "Even though I mentioned not to make it spicy, it wasn't prepared that way", 'review_id': 291693190, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084} 2025-03-31 00:59:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19497084&page=1> {'review': "Even though I mentioned not to make it spicy, it wasn't prepared that way", 'review_id': 291693190, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084} 2025-03-31 00:59:27 [reviews] INFO: Scraped item: {'review': 'worst biryani. this just tastes like plane biryani. worst biryani ever', 'review_id': 291002211, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084} 2025-03-31 00:59:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19497084&page=1> {'review': 'worst biryani. this just tastes like plane biryani. worst biryani ever', 'review_id': 291002211, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084} 2025-03-31 00:59:27 [reviews] INFO: Scraped item: {'review': "Why don't you have mutton biryani any more", 'review_id': 290516101, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084} 2025-03-31 00:59:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19497084&page=1> {'review': "Why don't you have mutton biryani any more", 'review_id': 290516101, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084} 2025-03-31 00:59:27 [reviews] INFO: Scraped item: {'review': 'not as per expectations chicken quality is too bad and not a single proper piece delivered ', 'review_id': 290302923, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084} 2025-03-31 00:59:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19497084&page=1> {'review': 'not as per expectations chicken quality is too bad and not a single proper piece delivered ', 'review_id': 290302923, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084} 2025-03-31 00:59:29 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:59:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:59:34 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 76, 'brand_name': "AKU'S - The Burger Co.", 'city': 'Gurgaon', 'sub_zone': 'DLF Cyber City', 'platform': 'zomato', 'res_id': 19497106, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382714, 'download_latency': 1.2896466255187988, 'depth': 0} 2025-03-31 00:59:34 [reviews] INFO: Scraped item: {'review': 'Yumm burger', 'review_id': 290213151, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-27', 'competitor_id': 76, 'brand_name': "AKU'S - The Burger Co.", 'city': 'Gurgaon', 'sub_zone': 'DLF Cyber City', 'platform': 'zomato', 'res_id': 19497106} 2025-03-31 00:59:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19497106&page=1> {'review': 'Yumm burger', 'review_id': 290213151, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-27', 'competitor_id': 76, 'brand_name': "AKU'S - The Burger Co.", 'city': 'Gurgaon', 'sub_zone': 'DLF Cyber City', 'platform': 'zomato', 'res_id': 19497106} 2025-03-31 00:59:34 [reviews] INFO: Scraped item: {'review': 'Burgers here are must try!', 'review_id': 290212856, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-27', 'competitor_id': 76, 'brand_name': "AKU'S - The Burger Co.", 'city': 'Gurgaon', 'sub_zone': 'DLF Cyber City', 'platform': 'zomato', 'res_id': 19497106} 2025-03-31 00:59:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19497106&page=1> {'review': 'Burgers here are must try!', 'review_id': 290212856, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-27', 'competitor_id': 76, 'brand_name': "AKU'S - The Burger Co.", 'city': 'Gurgaon', 'sub_zone': 'DLF Cyber City', 'platform': 'zomato', 'res_id': 19497106} 2025-03-31 00:59:34 [reviews] INFO: Stopping for res_id: 19497106 as reviews are older than 7 days. 2025-03-31 00:59:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:59:37 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 78, 'brand_name': 'Burger Seigneur', 'city': 'Bangalore', 'sub_zone': '1 Sobha', 'platform': 'zomato', 'res_id': 19503146, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382719, 'download_latency': 0.7244110107421875, 'depth': 0} 2025-03-31 00:59:37 [reviews] INFO: Stopping for res_id: 19503146 as reviews are older than 7 days. 2025-03-31 00:59:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 00:59:40 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382722, 'download_latency': 0.7161009311676025, 'depth': 0} 2025-03-31 00:59:40 [reviews] INFO: Scraped item: {'review': 'BAD DELIEVERY, they always always mess up ur order. Do not order', 'review_id': 291574651, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567} 2025-03-31 00:59:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19512567&page=1> {'review': 'BAD DELIEVERY, they always always mess up ur order. Do not order', 'review_id': 291574651, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567} 2025-03-31 00:59:40 [reviews] INFO: Scraped item: {'review': 'Analogue paneer being used. Too chewy, gravy was only colored water, fried rice quality was very bad. 1/10 th of broken rice being used', 'review_id': 291542008, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567} 2025-03-31 00:59:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19512567&page=1> {'review': 'Analogue paneer being used. Too chewy, gravy was only colored water, fried rice quality was very bad. 1/10 th of broken rice being used', 'review_id': 291542008, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567} 2025-03-31 00:59:40 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290918381, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567} 2025-03-31 00:59:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19512567&page=1> {'review': '', 'review_id': 290918381, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567} 2025-03-31 00:59:40 [reviews] INFO: Scraped item: {'review': 'Extra Schezwan dip missing', 'review_id': 290364589, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567} 2025-03-31 00:59:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19512567&page=1> {'review': 'Extra Schezwan dip missing', 'review_id': 290364589, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567} 2025-03-31 00:59:40 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290341988, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567} 2025-03-31 00:59:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19512567&page=1> {'review': '', 'review_id': 290341988, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567} 2025-03-31 00:59:43 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:59:45 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:59:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:59:53 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 00:59:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:00:01 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:00:05 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:00:09 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:00:12 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:00:16 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:00:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:00:21 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Noida', 'sub_zone': 'Chaukhandi', 'platform': 'zomato', 'res_id': 19519013, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382763, 'download_latency': 0.7360055446624756, 'depth': 0} 2025-03-31 01:00:21 [reviews] INFO: Scraped item: {'review': 'Tasty yet light Biryani as usual. The gulab jamuns were also great. ๐Ÿ‘๐Ÿฝ ', 'review_id': 291196166, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Noida', 'sub_zone': 'Chaukhandi', 'platform': 'zomato', 'res_id': 19519013} 2025-03-31 01:00:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19519013&page=1> {'review': 'Tasty yet light Biryani as usual. The gulab jamuns were also great. ๐Ÿ‘๐Ÿฝ ', 'review_id': 291196166, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Noida', 'sub_zone': 'Chaukhandi', 'platform': 'zomato', 'res_id': 19519013} 2025-03-31 01:00:21 [reviews] INFO: Scraped item: {'review': 'Earlier taste was too good but today, they started adding Capsicum in "Zaikedaar Paneer Biryani". also added more onion than ealier and also 20\'% less paneer than earlier. Never expect such adegrade in taste', 'review_id': 290456878, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Noida', 'sub_zone': 'Chaukhandi', 'platform': 'zomato', 'res_id': 19519013} 2025-03-31 01:00:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19519013&page=1> {'review': 'Earlier taste was too good but today, they started adding Capsicum in "Zaikedaar Paneer Biryani". also added more onion than ealier and also 20\'% less paneer than earlier. Never expect such adegrade in taste', 'review_id': 290456878, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Noida', 'sub_zone': 'Chaukhandi', 'platform': 'zomato', 'res_id': 19519013} 2025-03-31 01:00:21 [reviews] INFO: Stopping for res_id: 19519013 as reviews are older than 7 days. 2025-03-31 01:00:22 [scrapy.extensions.logstats] INFO: Crawled 130 pages (at 6 pages/min), scraped 409 items (at 19 items/min) 2025-03-31 01:00:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:00:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:00:31 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:00:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:00:34 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19530561, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382777, 'download_latency': 0.7369241714477539, 'depth': 0} 2025-03-31 01:00:34 [reviews] INFO: Scraped item: {'review': 'Excellent ', 'review_id': 289998716, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19530561} 2025-03-31 01:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530561&page=1> {'review': 'Excellent ', 'review_id': 289998716, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19530561} 2025-03-31 01:00:34 [reviews] INFO: Stopping for res_id: 19530561 as reviews are older than 7 days. 2025-03-31 01:00:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:00:39 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382781, 'download_latency': 0.7285723686218262, 'depth': 0} 2025-03-31 01:00:39 [reviews] INFO: Scraped item: {'review': 'The experience was like having a toast along with milkmaid, which I could have easily made at home. The true Shahi Tukda experience is of a bread toasted in ghee, and then drenched in delicious rabri made with a ton of nuts.', 'review_id': 291235301, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900} 2025-03-31 01:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530900&page=1> {'review': 'The experience was like having a toast along with milkmaid, which I could have easily made at home. The true Shahi Tukda experience is of a bread toasted in ghee, and then drenched in delicious rabri made with a ton of nuts.', 'review_id': 291235301, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900} 2025-03-31 01:00:39 [reviews] INFO: Scraped item: {'review': 'taste not good,no any masala used. like have eat plain rice. its not tasty.', 'review_id': 291178589, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900} 2025-03-31 01:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530900&page=1> {'review': 'taste not good,no any masala used. like have eat plain rice. its not tasty.', 'review_id': 291178589, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900} 2025-03-31 01:00:39 [reviews] INFO: Scraped item: {'review': 'Earlier taste was better. Now it got worse', 'review_id': 291020734, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900} 2025-03-31 01:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530900&page=1> {'review': 'Earlier taste was better. Now it got worse', 'review_id': 291020734, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900} 2025-03-31 01:00:39 [reviews] INFO: Scraped item: {'review': 'The biryani was nice but it was not spicy at all and even having a tomato test ๐Ÿ… more in biryani raita was good and even onion salad also good in test .', 'review_id': 291013913, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900} 2025-03-31 01:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530900&page=1> {'review': 'The biryani was nice but it was not spicy at all and even having a tomato test ๐Ÿ… more in biryani raita was good and even onion salad also good in test .', 'review_id': 291013913, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900} 2025-03-31 01:00:39 [reviews] INFO: Scraped item: {'review': 'quality vs quantity mismath', 'review_id': 290761548, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900} 2025-03-31 01:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530900&page=1> {'review': 'quality vs quantity mismath', 'review_id': 290761548, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900} 2025-03-31 01:00:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:00:45 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:00:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:00:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:00:58 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:01:02 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:01:04 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:01:08 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:01:11 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:01:14 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:01:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:01:19 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382821, 'download_latency': 0.8482725620269775, 'depth': 0} 2025-03-31 01:01:19 [reviews] INFO: Scraped item: {'review': 'all the sweet taste are very stale. There is little bitterness in them', 'review_id': 291779221, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041} 2025-03-31 01:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531041&page=1> {'review': 'all the sweet taste are very stale. There is little bitterness in them', 'review_id': 291779221, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041} 2025-03-31 01:01:19 [reviews] INFO: Scraped item: {'review': 'food was cold and cold drink was warm and overall was not as per i paid ', 'review_id': 291774345, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041} 2025-03-31 01:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531041&page=1> {'review': 'food was cold and cold drink was warm and overall was not as per i paid ', 'review_id': 291774345, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041} 2025-03-31 01:01:19 [reviews] INFO: Scraped item: {'review': 'Bit underwhelming compared to the usual taste. ', 'review_id': 291471717, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041} 2025-03-31 01:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531041&page=1> {'review': 'Bit underwhelming compared to the usual taste. ', 'review_id': 291471717, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041} 2025-03-31 01:01:19 [reviews] INFO: Scraped item: {'review': 'Last time it was way better! unsatisfactory this time', 'review_id': 291170356, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041} 2025-03-31 01:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531041&page=1> {'review': 'Last time it was way better! unsatisfactory this time', 'review_id': 291170356, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041} 2025-03-31 01:01:19 [reviews] INFO: Scraped item: {'review': 'Biryani is Salty and very Spicy , chicken leg pice is chewy and worse test (Even added cooking instructions less spicy NO USE)', 'review_id': 291165645, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041} 2025-03-31 01:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531041&page=1> {'review': 'Biryani is Salty and very Spicy , chicken leg pice is chewy and worse test (Even added cooking instructions less spicy NO USE)', 'review_id': 291165645, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041} 2025-03-31 01:01:22 [scrapy.extensions.logstats] INFO: Crawled 133 pages (at 3 pages/min), scraped 420 items (at 11 items/min) 2025-03-31 01:01:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:01:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:01:29 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:01:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:01:33 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'City Mall', 'platform': 'zomato', 'res_id': 19531051, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382835, 'download_latency': 0.6809489727020264, 'depth': 0} 2025-03-31 01:01:33 [reviews] INFO: Scraped item: {'review': 'they served us leftover Britani from the previous day, as it was stinking and Paneer was very hard... plus I and my daughter stomach is upset', 'review_id': 291681346, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'City Mall', 'platform': 'zomato', 'res_id': 19531051} 2025-03-31 01:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531051&page=1> {'review': 'they served us leftover Britani from the previous day, as it was stinking and Paneer was very hard... plus I and my daughter stomach is upset', 'review_id': 291681346, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'City Mall', 'platform': 'zomato', 'res_id': 19531051} 2025-03-31 01:01:33 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291160013, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'City Mall', 'platform': 'zomato', 'res_id': 19531051} 2025-03-31 01:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531051&page=1> {'review': '', 'review_id': 291160013, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'City Mall', 'platform': 'zomato', 'res_id': 19531051} 2025-03-31 01:01:33 [reviews] INFO: Scraped item: {'review': 'worst food ', 'review_id': 289718051, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'City Mall', 'platform': 'zomato', 'res_id': 19531051} 2025-03-31 01:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531051&page=1> {'review': 'worst food ', 'review_id': 289718051, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'City Mall', 'platform': 'zomato', 'res_id': 19531051} 2025-03-31 01:01:33 [reviews] INFO: Stopping for res_id: 19531051 as reviews are older than 7 days. 2025-03-31 01:01:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:01:36 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 43, 'brand_name': 'Wok Sushi Bao', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19542350, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382839, 'download_latency': 0.7018492221832275, 'depth': 0} 2025-03-31 01:01:36 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291709263, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 43, 'brand_name': 'Wok Sushi Bao', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19542350} 2025-03-31 01:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19542350&page=1> {'review': '', 'review_id': 291709263, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 43, 'brand_name': 'Wok Sushi Bao', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19542350} 2025-03-31 01:01:36 [reviews] INFO: Scraped item: {'review': 'There was no Nutella in my fruits. No chop sticks were provided as well.', 'review_id': 291622909, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 43, 'brand_name': 'Wok Sushi Bao', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19542350} 2025-03-31 01:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19542350&page=1> {'review': 'There was no Nutella in my fruits. No chop sticks were provided as well.', 'review_id': 291622909, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 43, 'brand_name': 'Wok Sushi Bao', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19542350} 2025-03-31 01:01:36 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291561774, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 43, 'brand_name': 'Wok Sushi Bao', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19542350} 2025-03-31 01:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19542350&page=1> {'review': '', 'review_id': 291561774, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 43, 'brand_name': 'Wok Sushi Bao', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19542350} 2025-03-31 01:01:36 [reviews] INFO: Scraped item: {'review': 'The noodles were over cooked and stuck together.. rest everything was great', 'review_id': 291332299, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 43, 'brand_name': 'Wok Sushi Bao', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19542350} 2025-03-31 01:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19542350&page=1> {'review': 'The noodles were over cooked and stuck together.. rest everything was great', 'review_id': 291332299, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 43, 'brand_name': 'Wok Sushi Bao', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19542350} 2025-03-31 01:01:36 [reviews] INFO: Stopping for res_id: 19542350 as reviews are older than 7 days. 2025-03-31 01:01:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:01:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:01:47 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:01:51 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:01:56 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:01:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:01:59 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382863, 'download_latency': 0.6831414699554443, 'depth': 0} 2025-03-31 01:01:59 [reviews] INFO: Scraped item: {'review': 'Best biryani ever', 'review_id': 291712597, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894} 2025-03-31 01:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19542894&page=1> {'review': 'Best biryani ever', 'review_id': 291712597, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894} 2025-03-31 01:01:59 [reviews] INFO: Scraped item: {'review': 'chicken Tangi rice- Chilen leg pcs was pathetic. The chicken leg pcs was very hard not soft. ', 'review_id': 291513147, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894} 2025-03-31 01:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19542894&page=1> {'review': 'chicken Tangi rice- Chilen leg pcs was pathetic. The chicken leg pcs was very hard not soft. ', 'review_id': 291513147, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894} 2025-03-31 01:01:59 [reviews] INFO: Scraped item: {'review': "The biryani was good but could have been better. The proportion of plain rice to gravy was bad so there's a lot of dry rice and I do feel the chicken was stale and had a gamey aftertaste.", 'review_id': 291142038, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894} 2025-03-31 01:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19542894&page=1> {'review': "The biryani was good but could have been better. The proportion of plain rice to gravy was bad so there's a lot of dry rice and I do feel the chicken was stale and had a gamey aftertaste.", 'review_id': 291142038, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894} 2025-03-31 01:01:59 [reviews] INFO: Stopping for res_id: 19542894 as reviews are older than 7 days. 2025-03-31 01:02:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:02:03 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Matunga', 'platform': 'zomato', 'res_id': 19548251, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382864, 'download_latency': 0.792288064956665, 'depth': 0} 2025-03-31 01:02:03 [reviews] INFO: Scraped item: {'review': 'Average pasta', 'review_id': 291635462, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Matunga', 'platform': 'zomato', 'res_id': 19548251} 2025-03-31 01:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19548251&page=1> {'review': 'Average pasta', 'review_id': 291635462, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Matunga', 'platform': 'zomato', 'res_id': 19548251} 2025-03-31 01:02:03 [reviews] INFO: Scraped item: {'review': "Today I've ordered from The dough therapy,matunga...on my kids demand i ordered Nutella dough ball for my kids...these dough balls are my all time favorites hence ordering frequently... really chocolaty and Creamy..do order it for ur sweet craving ", 'review_id': 291245618, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Matunga', 'platform': 'zomato', 'res_id': 19548251} 2025-03-31 01:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19548251&page=1> {'review': "Today I've ordered from The dough therapy,matunga...on my kids demand i ordered Nutella dough ball for my kids...these dough balls are my all time favorites hence ordering frequently... really chocolaty and Creamy..do order it for ur sweet craving ", 'review_id': 291245618, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Matunga', 'platform': 'zomato', 'res_id': 19548251} 2025-03-31 01:02:03 [reviews] INFO: Scraped item: {'review': "Today's iftar special for my kids is ,B bay truffle fries from the dough Therapy,matunga outlet...this fries is my all time favorite hence ordering frequently from here...itsbso crunchy and the creamy din is increasing the taste..so do try", 'review_id': 291242161, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Matunga', 'platform': 'zomato', 'res_id': 19548251} 2025-03-31 01:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19548251&page=1> {'review': "Today's iftar special for my kids is ,B bay truffle fries from the dough Therapy,matunga outlet...this fries is my all time favorite hence ordering frequently from here...itsbso crunchy and the creamy din is increasing the taste..so do try", 'review_id': 291242161, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Matunga', 'platform': 'zomato', 'res_id': 19548251} 2025-03-31 01:02:03 [reviews] INFO: Scraped item: {'review': "Today I've ordered first tym from the dough therapy,matunga...I tried their classico pizza which is good in portion wise..I choose african crust base for my pizza and it's really delicious..must try guyss", 'review_id': 291240708, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Matunga', 'platform': 'zomato', 'res_id': 19548251} 2025-03-31 01:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19548251&page=1> {'review': "Today I've ordered first tym from the dough therapy,matunga...I tried their classico pizza which is good in portion wise..I choose african crust base for my pizza and it's really delicious..must try guyss", 'review_id': 291240708, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Matunga', 'platform': 'zomato', 'res_id': 19548251} 2025-03-31 01:02:03 [reviews] INFO: Scraped item: {'review': 'The delivery was quick, and the pizza arrived hot and fresh. The classic veg pizza was tasty with a good balance of toppings and cheese. Satisfied with the service.', 'review_id': 291225464, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Matunga', 'platform': 'zomato', 'res_id': 19548251} 2025-03-31 01:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19548251&page=1> {'review': 'The delivery was quick, and the pizza arrived hot and fresh. The classic veg pizza was tasty with a good balance of toppings and cheese. Satisfied with the service.', 'review_id': 291225464, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Matunga', 'platform': 'zomato', 'res_id': 19548251} 2025-03-31 01:02:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:02:07 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19548739, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382868, 'download_latency': 0.7074325084686279, 'depth': 0} 2025-03-31 01:02:07 [reviews] INFO: Scraped item: {'review': 'I got my order very late not good ', 'review_id': 291780023, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19548739} 2025-03-31 01:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19548739&page=1> {'review': 'I got my order very late not good ', 'review_id': 291780023, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19548739} 2025-03-31 01:02:07 [reviews] INFO: Scraped item: {'review': 'chicken is raw', 'review_id': 291517467, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19548739} 2025-03-31 01:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19548739&page=1> {'review': 'chicken is raw', 'review_id': 291517467, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19548739} 2025-03-31 01:02:07 [reviews] INFO: Scraped item: {'review': 'Both Biryani chicken is raw', 'review_id': 290769054, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19548739} 2025-03-31 01:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19548739&page=1> {'review': 'Both Biryani chicken is raw', 'review_id': 290769054, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19548739} 2025-03-31 01:02:07 [reviews] INFO: Scraped item: {'review': 'It was very good. However a bit salty. ', 'review_id': 290220292, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19548739} 2025-03-31 01:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19548739&page=1> {'review': 'It was very good. However a bit salty. ', 'review_id': 290220292, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19548739} 2025-03-31 01:02:07 [reviews] INFO: Scraped item: {'review': '', 'review_id': 289981584, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19548739} 2025-03-31 01:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19548739&page=1> {'review': '', 'review_id': 289981584, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19548739} 2025-03-31 01:02:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:02:12 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 83, 'brand_name': 'Chaayos Chai+Snacks=Relax', 'city': 'Mumbai', 'sub_zone': 'Churchgate', 'platform': 'zomato', 'res_id': 19549569, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382872, 'download_latency': 0.7343084812164307, 'depth': 0} 2025-03-31 01:02:12 [reviews] INFO: Scraped item: {'review': 'would like to see more QUANTITY on delivery but taste aroma and thickness was good ! packaging charges are too much can be reduced!!', 'review_id': 290422477, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 83, 'brand_name': 'Chaayos Chai+Snacks=Relax', 'city': 'Mumbai', 'sub_zone': 'Churchgate', 'platform': 'zomato', 'res_id': 19549569} 2025-03-31 01:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19549569&page=1> {'review': 'would like to see more QUANTITY on delivery but taste aroma and thickness was good ! packaging charges are too much can be reduced!!', 'review_id': 290422477, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 83, 'brand_name': 'Chaayos Chai+Snacks=Relax', 'city': 'Mumbai', 'sub_zone': 'Churchgate', 'platform': 'zomato', 'res_id': 19549569} 2025-03-31 01:02:12 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290404826, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 83, 'brand_name': 'Chaayos Chai+Snacks=Relax', 'city': 'Mumbai', 'sub_zone': 'Churchgate', 'platform': 'zomato', 'res_id': 19549569} 2025-03-31 01:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19549569&page=1> {'review': '', 'review_id': 290404826, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 83, 'brand_name': 'Chaayos Chai+Snacks=Relax', 'city': 'Mumbai', 'sub_zone': 'Churchgate', 'platform': 'zomato', 'res_id': 19549569} 2025-03-31 01:02:12 [reviews] INFO: Scraped item: {'review': "Matcha could've been dissolved a little more", 'review_id': 289903128, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 83, 'brand_name': 'Chaayos Chai+Snacks=Relax', 'city': 'Mumbai', 'sub_zone': 'Churchgate', 'platform': 'zomato', 'res_id': 19549569} 2025-03-31 01:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19549569&page=1> {'review': "Matcha could've been dissolved a little more", 'review_id': 289903128, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 83, 'brand_name': 'Chaayos Chai+Snacks=Relax', 'city': 'Mumbai', 'sub_zone': 'Churchgate', 'platform': 'zomato', 'res_id': 19549569} 2025-03-31 01:02:12 [reviews] INFO: Stopping for res_id: 19549569 as reviews are older than 7 days. 2025-03-31 01:02:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:02:16 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Juhu', 'platform': 'zomato', 'res_id': 19559682, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382874, 'download_latency': 0.8372831344604492, 'depth': 0} 2025-03-31 01:02:16 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291708109, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Juhu', 'platform': 'zomato', 'res_id': 19559682} 2025-03-31 01:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19559682&page=1> {'review': '', 'review_id': 291708109, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Juhu', 'platform': 'zomato', 'res_id': 19559682} 2025-03-31 01:02:16 [reviews] INFO: Scraped item: {'review': 'Order not received', 'review_id': 291023601, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Juhu', 'platform': 'zomato', 'res_id': 19559682} 2025-03-31 01:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19559682&page=1> {'review': 'Order not received', 'review_id': 291023601, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Juhu', 'platform': 'zomato', 'res_id': 19559682} 2025-03-31 01:02:16 [reviews] INFO: Scraped item: {'review': 'taste change not satisfied ', 'review_id': 290998282, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Juhu', 'platform': 'zomato', 'res_id': 19559682} 2025-03-31 01:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19559682&page=1> {'review': 'taste change not satisfied ', 'review_id': 290998282, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Juhu', 'platform': 'zomato', 'res_id': 19559682} 2025-03-31 01:02:16 [reviews] INFO: Scraped item: {'review': 'The prawns were stinking and were not at all fresh', 'review_id': 289726259, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Juhu', 'platform': 'zomato', 'res_id': 19559682} 2025-03-31 01:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19559682&page=1> {'review': 'The prawns were stinking and were not at all fresh', 'review_id': 289726259, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Juhu', 'platform': 'zomato', 'res_id': 19559682} 2025-03-31 01:02:16 [reviews] INFO: Stopping for res_id: 19559682 as reviews are older than 7 days. 2025-03-31 01:02:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:02:19 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382879, 'download_latency': 0.7401087284088135, 'depth': 0} 2025-03-31 01:02:19 [reviews] INFO: Scraped item: {'review': 'kathal biryani had no kathal pieces, no masala. this is not the first time i have ordered it and had a good experience every other time. this time was a big big disappointment ', 'review_id': 291632682, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464} 2025-03-31 01:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19562464&page=1> {'review': 'kathal biryani had no kathal pieces, no masala. this is not the first time i have ordered it and had a good experience every other time. this time was a big big disappointment ', 'review_id': 291632682, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464} 2025-03-31 01:02:19 [reviews] INFO: Scraped item: {'review': 'Usually the briyani is very good but today it was bad. It had no gravy and no vegetables just plain boiled rice. Had a bad experience but not order again', 'review_id': 291529474, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464} 2025-03-31 01:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19562464&page=1> {'review': 'Usually the briyani is very good but today it was bad. It had no gravy and no vegetables just plain boiled rice. Had a bad experience but not order again', 'review_id': 291529474, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464} 2025-03-31 01:02:19 [reviews] INFO: Scraped item: {'review': "very poor quantity..and smelling bitter as if it's rotten", 'review_id': 291326442, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464} 2025-03-31 01:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19562464&page=1> {'review': "very poor quantity..and smelling bitter as if it's rotten", 'review_id': 291326442, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464} 2025-03-31 01:02:19 [reviews] INFO: Scraped item: {'review': 'Delay', 'review_id': 290773751, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464} 2025-03-31 01:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19562464&page=1> {'review': 'Delay', 'review_id': 290773751, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464} 2025-03-31 01:02:19 [reviews] INFO: Scraped item: {'review': 'Uncooked chicken', 'review_id': 290699591, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464} 2025-03-31 01:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19562464&page=1> {'review': 'Uncooked chicken', 'review_id': 290699591, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464} 2025-03-31 01:02:22 [scrapy.extensions.logstats] INFO: Crawled 141 pages (at 8 pages/min), scraped 452 items (at 32 items/min) 2025-03-31 01:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-31 01:02:24 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-31 01:02:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:02:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:02:30 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:02:35 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:02:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:02:39 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19566888, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382896, 'download_latency': 0.7120339870452881, 'depth': 0} 2025-03-31 01:02:39 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291675403, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19566888} 2025-03-31 01:02:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19566888&page=1> {'review': '', 'review_id': 291675403, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19566888} 2025-03-31 01:02:39 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291288696, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19566888} 2025-03-31 01:02:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19566888&page=1> {'review': '', 'review_id': 291288696, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19566888} 2025-03-31 01:02:39 [reviews] INFO: Scraped item: {'review': 'packaging, and the taste was good. But has it mentioned that it will serve 4-5 members. but it was not served hardly 3 members have eat. Otherwise the quantity you gave us less. orelse you should give more quantity or make it has serves 3 ppl.', 'review_id': 291183067, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19566888} 2025-03-31 01:02:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19566888&page=1> {'review': 'packaging, and the taste was good. But has it mentioned that it will serve 4-5 members. but it was not served hardly 3 members have eat. Otherwise the quantity you gave us less. orelse you should give more quantity or make it has serves 3 ppl.', 'review_id': 291183067, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19566888} 2025-03-31 01:02:39 [reviews] INFO: Stopping for res_id: 19566888 as reviews are older than 7 days. 2025-03-31 01:02:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:02:45 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:02:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:02:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:02:54 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382912, 'download_latency': 0.7386593818664551, 'depth': 0} 2025-03-31 01:02:54 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291694257, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166} 2025-03-31 01:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19570166&page=1> {'review': '', 'review_id': 291694257, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166} 2025-03-31 01:02:54 [reviews] INFO: Scraped item: {'review': '

Today, I ordered biryani along with starters for lunch. While the biryani was fine, I was really disappointed with the starter. It seemed more like an oily curry, which is not something I would expect from a starter. Looking at the photo, Iโ€™m wondering how anyone could consider this a proper starter. Honestly, itโ€™s disheartening, and I feel that consuming such a dish could potentially harm our health in the long run. Iโ€™m sorry to say this, but it was quite disappointing."


', 'review_id': 291532229, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166} 2025-03-31 01:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19570166&page=1> {'review': '

Today, I ordered biryani along with starters for lunch. While the biryani was fine, I was really disappointed with the starter. It seemed more like an oily curry, which is not something I would expect from a starter. Looking at the photo, Iโ€™m wondering how anyone could consider this a proper starter. Honestly, itโ€™s disheartening, and I feel that consuming such a dish could potentially harm our health in the long run. Iโ€™m sorry to say this, but it was quite disappointing."


', 'review_id': 291532229, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166} 2025-03-31 01:02:54 [reviews] INFO: Scraped item: {'review': "it wasn't spicy enough. Biryani masala was missing, I got simple plain rice coated with colour.", 'review_id': 291364813, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166} 2025-03-31 01:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19570166&page=1> {'review': "it wasn't spicy enough. Biryani masala was missing, I got simple plain rice coated with colour.", 'review_id': 291364813, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166} 2025-03-31 01:02:54 [reviews] INFO: Scraped item: {'review': 'taste is good!', 'review_id': 291041245, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166} 2025-03-31 01:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19570166&page=1> {'review': 'taste is good!', 'review_id': 291041245, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166} 2025-03-31 01:02:54 [reviews] INFO: Scraped item: {'review': 'the biryani was totally cold because of long delivery time ', 'review_id': 291000043, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166} 2025-03-31 01:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19570166&page=1> {'review': 'the biryani was totally cold because of long delivery time ', 'review_id': 291000043, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166} 2025-03-31 01:02:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:02:56 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 82, 'brand_name': 'Sesami Asian Kitchen Bar', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19590530, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382916, 'download_latency': 0.7456569671630859, 'depth': 0} 2025-03-31 01:02:56 [reviews] INFO: Stopping for res_id: 19590530 as reviews are older than 7 days. 2025-03-31 01:03:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:03:00 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 11, 'brand_name': 'Royal China', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19592218, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382920, 'download_latency': 0.7864460945129395, 'depth': 0} 2025-03-31 01:03:00 [reviews] INFO: Scraped item: {'review': "Food was 45 mins late. Wasn't even able to complain about the order", 'review_id': 291707930, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 11, 'brand_name': 'Royal China', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19592218} 2025-03-31 01:03:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19592218&page=1> {'review': "Food was 45 mins late. Wasn't even able to complain about the order", 'review_id': 291707930, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 11, 'brand_name': 'Royal China', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19592218} 2025-03-31 01:03:00 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291630148, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 11, 'brand_name': 'Royal China', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19592218} 2025-03-31 01:03:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19592218&page=1> {'review': '', 'review_id': 291630148, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 11, 'brand_name': 'Royal China', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19592218} 2025-03-31 01:03:00 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291254509, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 11, 'brand_name': 'Royal China', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19592218} 2025-03-31 01:03:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19592218&page=1> {'review': '', 'review_id': 291254509, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 11, 'brand_name': 'Royal China', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19592218} 2025-03-31 01:03:00 [reviews] INFO: Scraped item: {'review': 'Sweet and Sour Prawns were not fresh', 'review_id': 290896653, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 11, 'brand_name': 'Royal China', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19592218} 2025-03-31 01:03:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19592218&page=1> {'review': 'Sweet and Sour Prawns were not fresh', 'review_id': 290896653, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 11, 'brand_name': 'Royal China', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19592218} 2025-03-31 01:03:00 [reviews] INFO: Stopping for res_id: 19592218 as reviews are older than 7 days. 2025-03-31 01:03:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:03:03 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382924, 'download_latency': 0.7718508243560791, 'depth': 0} 2025-03-31 01:03:03 [reviews] INFO: Scraped item: {'review': 'told to not add green onion still it is there why first of all it is delayed and even send teh food with green onion ', 'review_id': 291183477, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926} 2025-03-31 01:03:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19644926&page=1> {'review': 'told to not add green onion still it is there why first of all it is delayed and even send teh food with green onion ', 'review_id': 291183477, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926} 2025-03-31 01:03:03 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291035216, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926} 2025-03-31 01:03:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19644926&page=1> {'review': '', 'review_id': 291035216, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926} 2025-03-31 01:03:03 [reviews] INFO: Scraped item: {'review': "rice was extremely salty and the lollypop didn't taste good or fresh", 'review_id': 290808091, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926} 2025-03-31 01:03:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19644926&page=1> {'review': "rice was extremely salty and the lollypop didn't taste good or fresh", 'review_id': 290808091, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926} 2025-03-31 01:03:03 [reviews] INFO: Scraped item: {'review': 'tasteless food', 'review_id': 290358984, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926} 2025-03-31 01:03:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19644926&page=1> {'review': 'tasteless food', 'review_id': 290358984, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926} 2025-03-31 01:03:03 [reviews] INFO: Stopping for res_id: 19644926 as reviews are older than 7 days. 2025-03-31 01:03:06 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:03:11 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:03:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:03:13 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382936, 'download_latency': 0.7108864784240723, 'depth': 0} 2025-03-31 01:03:13 [reviews] INFO: Scraped item: {'review': 'Rahul has been very good with service', 'review_id': 291598036, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023} 2025-03-31 01:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19645023&page=1> {'review': 'Rahul has been very good with service', 'review_id': 291598036, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023} 2025-03-31 01:03:13 [reviews] INFO: Scraped item: {'review': 'Nice', 'review_id': 291266416, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023} 2025-03-31 01:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19645023&page=1> {'review': 'Nice', 'review_id': 291266416, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023} 2025-03-31 01:03:13 [reviews] INFO: Scraped item: {'review': 'Amazing food and service', 'review_id': 291171027, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023} 2025-03-31 01:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19645023&page=1> {'review': 'Amazing food and service', 'review_id': 291171027, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023} 2025-03-31 01:03:13 [reviews] INFO: Scraped item: {'review': 'The food was completely bland and tasteless.', 'review_id': 290997800, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023} 2025-03-31 01:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19645023&page=1> {'review': 'The food was completely bland and tasteless.', 'review_id': 290997800, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023} 2025-03-31 01:03:13 [reviews] INFO: Scraped item: {'review': 'Gaurav ensured very seamless and comfortable service.', 'review_id': 290976736, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-29', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023} 2025-03-31 01:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19645023&page=1> {'review': 'Gaurav ensured very seamless and comfortable service.', 'review_id': 290976736, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-29', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023} 2025-03-31 01:03:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:03:17 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 68, 'brand_name': 'Fat Monk Chinese', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 19646158, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382939, 'download_latency': 0.7381236553192139, 'depth': 0} 2025-03-31 01:03:17 [reviews] INFO: Stopping for res_id: 19646158 as reviews are older than 7 days. 2025-03-31 01:03:21 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:03:22 [scrapy.extensions.logstats] INFO: Crawled 148 pages (at 7 pages/min), scraped 473 items (at 21 items/min) 2025-03-31 01:03:25 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:03:28 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:03:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:03:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:03:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:03:43 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:03:47 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:03:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:03:51 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Kandivali', 'platform': 'zomato', 'res_id': 19692864, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382974, 'download_latency': 0.8547556400299072, 'depth': 0} 2025-03-31 01:03:51 [reviews] INFO: Scraped item: {'review': 'the large spicy paneer pizza costing more than 600 even after applying discount had only small bits and pieces of paneer, and the rest was only onion. In our country, 200g good quality paneer usually comes within 200. So why does pizza worth 600-700 not even have paneer worth rs. 50 on it? are the food delivery apps charges cutting into the restuarants profits so much that they need to dupe customers? or the restaurant itself is doing it to gullible customers to increase profit margins?', 'review_id': 291304980, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Kandivali', 'platform': 'zomato', 'res_id': 19692864} 2025-03-31 01:03:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19692864&page=1> {'review': 'the large spicy paneer pizza costing more than 600 even after applying discount had only small bits and pieces of paneer, and the rest was only onion. In our country, 200g good quality paneer usually comes within 200. So why does pizza worth 600-700 not even have paneer worth rs. 50 on it? are the food delivery apps charges cutting into the restuarants profits so much that they need to dupe customers? or the restaurant itself is doing it to gullible customers to increase profit margins?', 'review_id': 291304980, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Kandivali', 'platform': 'zomato', 'res_id': 19692864} 2025-03-31 01:03:51 [reviews] INFO: Scraped item: {'review': 'The French fries were cooked to a perfect golden crisp, with a deliciously fluffy interior! The seasoning was spot on, adding a burst of flavor to each bite. The nice packaging was a lovely touch, keeping the fries fresh and hot!', 'review_id': 291173272, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Kandivali', 'platform': 'zomato', 'res_id': 19692864} 2025-03-31 01:03:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19692864&page=1> {'review': 'The French fries were cooked to a perfect golden crisp, with a deliciously fluffy interior! The seasoning was spot on, adding a burst of flavor to each bite. The nice packaging was a lovely touch, keeping the fries fresh and hot!', 'review_id': 291173272, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Kandivali', 'platform': 'zomato', 'res_id': 19692864} 2025-03-31 01:03:51 [reviews] INFO: Scraped item: {'review': 'The Nutella Dough balls were very tasty.It was filled with Nutella.It was served hot and packaged well. Totally satisfied my chocolate cravings Would try them again.', 'review_id': 291169757, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Kandivali', 'platform': 'zomato', 'res_id': 19692864} 2025-03-31 01:03:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19692864&page=1> {'review': 'The Nutella Dough balls were very tasty.It was filled with Nutella.It was served hot and packaged well. Totally satisfied my chocolate cravings Would try them again.', 'review_id': 291169757, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Kandivali', 'platform': 'zomato', 'res_id': 19692864} 2025-03-31 01:03:51 [reviews] INFO: Scraped item: {'review': 'REALLY tasty pizza with 4 types of cheese better than any Margherita i prefer this and they also gave oil in small bottles highly recommend this place ', 'review_id': 291166782, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Kandivali', 'platform': 'zomato', 'res_id': 19692864} 2025-03-31 01:03:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19692864&page=1> {'review': 'REALLY tasty pizza with 4 types of cheese better than any Margherita i prefer this and they also gave oil in small bottles highly recommend this place ', 'review_id': 291166782, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Kandivali', 'platform': 'zomato', 'res_id': 19692864} 2025-03-31 01:03:51 [reviews] INFO: Scraped item: {'review': 'Classico Pizza is a culinary masterpiece! The crust is made from freshly baked dough, crispy on the outside and soft on the inside, providing a perfect base for the medley of fresh veggies on top. The vibrant toppings, including juicy tomatoes, crunchy bell peppers, and fragrant onions, add a burst of flavor and color to each slice. A must-try for pizza lovers seeking a delicious and satisfying experience!', 'review_id': 290706879, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Kandivali', 'platform': 'zomato', 'res_id': 19692864} 2025-03-31 01:03:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19692864&page=1> {'review': 'Classico Pizza is a culinary masterpiece! The crust is made from freshly baked dough, crispy on the outside and soft on the inside, providing a perfect base for the medley of fresh veggies on top. The vibrant toppings, including juicy tomatoes, crunchy bell peppers, and fragrant onions, add a burst of flavor and color to each slice. A must-try for pizza lovers seeking a delicious and satisfying experience!', 'review_id': 290706879, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Kandivali', 'platform': 'zomato', 'res_id': 19692864} 2025-03-31 01:03:55 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:03:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:03:59 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 87, 'brand_name': 'Sandwizzaa', 'city': 'Mumbai', 'sub_zone': 'Shivaji Park', 'platform': 'zomato', 'res_id': 19699605, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382980, 'download_latency': 0.725398063659668, 'depth': 0} 2025-03-31 01:03:59 [reviews] INFO: Scraped item: {'review': 'the veg cheese toast grill was burnt ', 'review_id': 291461026, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 87, 'brand_name': 'Sandwizzaa', 'city': 'Mumbai', 'sub_zone': 'Shivaji Park', 'platform': 'zomato', 'res_id': 19699605} 2025-03-31 01:03:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19699605&page=1> {'review': 'the veg cheese toast grill was burnt ', 'review_id': 291461026, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 87, 'brand_name': 'Sandwizzaa', 'city': 'Mumbai', 'sub_zone': 'Shivaji Park', 'platform': 'zomato', 'res_id': 19699605} 2025-03-31 01:03:59 [reviews] INFO: Scraped item: {'review': 'There was no taste in the sandwich at all. Only raw vggies were put and the bread was just grilled and given. Rubbish for 300 bucks', 'review_id': 291440154, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 87, 'brand_name': 'Sandwizzaa', 'city': 'Mumbai', 'sub_zone': 'Shivaji Park', 'platform': 'zomato', 'res_id': 19699605} 2025-03-31 01:03:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19699605&page=1> {'review': 'There was no taste in the sandwich at all. Only raw vggies were put and the bread was just grilled and given. Rubbish for 300 bucks', 'review_id': 291440154, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 87, 'brand_name': 'Sandwizzaa', 'city': 'Mumbai', 'sub_zone': 'Shivaji Park', 'platform': 'zomato', 'res_id': 19699605} 2025-03-31 01:03:59 [reviews] INFO: Scraped item: {'review': 'order was delayed and toast sandwich had got cold', 'review_id': 291191723, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 87, 'brand_name': 'Sandwizzaa', 'city': 'Mumbai', 'sub_zone': 'Shivaji Park', 'platform': 'zomato', 'res_id': 19699605} 2025-03-31 01:03:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19699605&page=1> {'review': 'order was delayed and toast sandwich had got cold', 'review_id': 291191723, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 87, 'brand_name': 'Sandwizzaa', 'city': 'Mumbai', 'sub_zone': 'Shivaji Park', 'platform': 'zomato', 'res_id': 19699605} 2025-03-31 01:03:59 [reviews] INFO: Scraped item: {'review': "wasn't tasting well", 'review_id': 290248657, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 87, 'brand_name': 'Sandwizzaa', 'city': 'Mumbai', 'sub_zone': 'Shivaji Park', 'platform': 'zomato', 'res_id': 19699605} 2025-03-31 01:03:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19699605&page=1> {'review': "wasn't tasting well", 'review_id': 290248657, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 87, 'brand_name': 'Sandwizzaa', 'city': 'Mumbai', 'sub_zone': 'Shivaji Park', 'platform': 'zomato', 'res_id': 19699605} 2025-03-31 01:03:59 [reviews] INFO: Scraped item: {'review': 'Only one tandoori toast was delivered. I ordered 3 sandhwiches', 'review_id': 290210211, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 87, 'brand_name': 'Sandwizzaa', 'city': 'Mumbai', 'sub_zone': 'Shivaji Park', 'platform': 'zomato', 'res_id': 19699605} 2025-03-31 01:03:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19699605&page=1> {'review': 'Only one tandoori toast was delivered. I ordered 3 sandhwiches', 'review_id': 290210211, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 87, 'brand_name': 'Sandwizzaa', 'city': 'Mumbai', 'sub_zone': 'Shivaji Park', 'platform': 'zomato', 'res_id': 19699605} 2025-03-31 01:04:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:04:02 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382984, 'download_latency': 0.7114527225494385, 'depth': 0} 2025-03-31 01:04:02 [reviews] INFO: Scraped item: {'review': 'Sadiq gave a good service', 'review_id': 291694026, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667} 2025-03-31 01:04:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19709667&page=1> {'review': 'Sadiq gave a good service', 'review_id': 291694026, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667} 2025-03-31 01:04:02 [reviews] INFO: Scraped item: {'review': 'The service received from Mr Nishit Paul was superb and the items he recommended were too good', 'review_id': 291524339, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667} 2025-03-31 01:04:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19709667&page=1> {'review': 'The service received from Mr Nishit Paul was superb and the items he recommended were too good', 'review_id': 291524339, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667} 2025-03-31 01:04:02 [reviews] INFO: Scraped item: {'review': 'Nice service ', 'review_id': 291505321, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667} 2025-03-31 01:04:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19709667&page=1> {'review': 'Nice service ', 'review_id': 291505321, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667} 2025-03-31 01:04:02 [reviews] INFO: Scraped item: {'review': 'excellent food service was also good', 'review_id': 291504851, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667} 2025-03-31 01:04:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19709667&page=1> {'review': 'excellent food service was also good', 'review_id': 291504851, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667} 2025-03-31 01:04:02 [reviews] INFO: Scraped item: {'review': "the food was delicious, the staff was very friendly, Randheer's recommendations were very good.", 'review_id': 291373715, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667} 2025-03-31 01:04:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19709667&page=1> {'review': "the food was delicious, the staff was very friendly, Randheer's recommendations were very good.", 'review_id': 291373715, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667} 2025-03-31 01:04:06 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:04:09 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:04:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:04:14 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 95, 'brand_name': 'Mad Over Donuts', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19712420, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743382994, 'download_latency': 0.8063945770263672, 'depth': 0} 2025-03-31 01:04:14 [reviews] INFO: Stopping for res_id: 19712420 as reviews are older than 7 days. 2025-03-31 01:04:17 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:04:21 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:04:22 [scrapy.extensions.logstats] INFO: Crawled 152 pages (at 4 pages/min), scraped 488 items (at 15 items/min) 2025-03-31 01:04:25 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:04:29 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:04:33 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:04:36 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:04:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:04:44 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:04:47 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:04:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:04:51 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383032, 'download_latency': 0.707730770111084, 'depth': 0} 2025-03-31 01:04:51 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291388856, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214} 2025-03-31 01:04:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19745214&page=1> {'review': '', 'review_id': 291388856, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214} 2025-03-31 01:04:51 [reviews] INFO: Scraped item: {'review': 'no taste ', 'review_id': 291381120, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214} 2025-03-31 01:04:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19745214&page=1> {'review': 'no taste ', 'review_id': 291381120, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214} 2025-03-31 01:04:51 [reviews] INFO: Scraped item: {'review': "Didn't like the food as expected", 'review_id': 290825052, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214} 2025-03-31 01:04:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19745214&page=1> {'review': "Didn't like the food as expected", 'review_id': 290825052, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214} 2025-03-31 01:04:52 [reviews] INFO: Stopping for res_id: 19745214 as reviews are older than 7 days. 2025-03-31 01:04:55 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:04:59 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:05:03 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:05:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:05:10 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:05:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:05:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:05:22 [scrapy.extensions.logstats] INFO: Crawled 153 pages (at 1 pages/min), scraped 491 items (at 3 items/min) 2025-03-31 01:05:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:05:26 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:05:30 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:05:34 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:05:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:05:38 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 3, 'brand_name': 'Art Of Dum', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 19769266, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383077, 'download_latency': 0.8699922561645508, 'depth': 0} 2025-03-31 01:05:38 [reviews] INFO: Scraped item: {'review': 'Extremely bland with no flavour profile. Surprising since their non-veg kebabs are lovely!', 'review_id': 289899434, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 3, 'brand_name': 'Art Of Dum', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 19769266} 2025-03-31 01:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19769266&page=1> {'review': 'Extremely bland with no flavour profile. Surprising since their non-veg kebabs are lovely!', 'review_id': 289899434, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 3, 'brand_name': 'Art Of Dum', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 19769266} 2025-03-31 01:05:38 [reviews] INFO: Scraped item: {'review': 'Excellent food. Superb taste and quality. Packaging is exceptionally neat and the raita , pickle and other accompaniments very good.', 'review_id': 289603403, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 3, 'brand_name': 'Art Of Dum', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 19769266} 2025-03-31 01:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19769266&page=1> {'review': 'Excellent food. Superb taste and quality. Packaging is exceptionally neat and the raita , pickle and other accompaniments very good.', 'review_id': 289603403, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 3, 'brand_name': 'Art Of Dum', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 19769266} 2025-03-31 01:05:38 [reviews] INFO: Stopping for res_id: 19769266 as reviews are older than 7 days. 2025-03-31 01:05:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:05:44 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:05:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:05:48 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19824933, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383088, 'download_latency': 0.7166304588317871, 'depth': 0} 2025-03-31 01:05:48 [reviews] INFO: Stopping for res_id: 19824933 as reviews are older than 7 days. 2025-03-31 01:05:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:05:52 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 86, 'brand_name': 'Health Juice Centre', 'city': 'Mumbai', 'sub_zone': 'Girgaum', 'platform': 'zomato', 'res_id': 19831252, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383092, 'download_latency': 0.8770921230316162, 'depth': 0} 2025-03-31 01:05:52 [reviews] INFO: Stopping for res_id: 19831252 as reviews are older than 7 days. 2025-03-31 01:05:56 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:06:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:06:04 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:06:08 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:06:12 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:06:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:06:19 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:06:22 [scrapy.extensions.logstats] INFO: Crawled 156 pages (at 3 pages/min), scraped 493 items (at 2 items/min) 2025-03-31 01:06:23 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:06:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:06:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:06:32 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383131, 'download_latency': 0.7369050979614258, 'depth': 0} 2025-03-31 01:06:32 [reviews] INFO: Scraped item: {'review': 'good ', 'review_id': 291780764, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717} 2025-03-31 01:06:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19832717&page=1> {'review': 'good ', 'review_id': 291780764, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717} 2025-03-31 01:06:32 [reviews] INFO: Scraped item: {'review': "noodles were merely boiled and not flavoured. rice tasted substandard and poor grain was used. sweet chili chicken wasn't cooked well", 'review_id': 291712665, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717} 2025-03-31 01:06:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19832717&page=1> {'review': "noodles were merely boiled and not flavoured. rice tasted substandard and poor grain was used. sweet chili chicken wasn't cooked well", 'review_id': 291712665, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717} 2025-03-31 01:06:32 [reviews] INFO: Scraped item: {'review': 'There was no salt in pot rice', 'review_id': 291662754, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717} 2025-03-31 01:06:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19832717&page=1> {'review': 'There was no salt in pot rice', 'review_id': 291662754, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717} 2025-03-31 01:06:32 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291277786, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717} 2025-03-31 01:06:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19832717&page=1> {'review': '', 'review_id': 291277786, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717} 2025-03-31 01:06:32 [reviews] INFO: Scraped item: {'review': 'momos I tried first time...were quite delicious and cheese stuffing. worth repeating the order. ', 'review_id': 291062938, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717} 2025-03-31 01:06:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19832717&page=1> {'review': 'momos I tried first time...were quite delicious and cheese stuffing. worth repeating the order. ', 'review_id': 291062938, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717} 2025-03-31 01:06:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:06:35 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19845961, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383134, 'download_latency': 0.8722314834594727, 'depth': 0} 2025-03-31 01:06:35 [reviews] INFO: Scraped item: {'review': 'The quantity was slightly low. it is sufficient for only one person. ', 'review_id': 291737911, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19845961} 2025-03-31 01:06:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19845961&page=1> {'review': 'The quantity was slightly low. it is sufficient for only one person. ', 'review_id': 291737911, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19845961} 2025-03-31 01:06:35 [reviews] INFO: Scraped item: {'review': 'test less ', 'review_id': 291561048, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19845961} 2025-03-31 01:06:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19845961&page=1> {'review': 'test less ', 'review_id': 291561048, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19845961} 2025-03-31 01:06:35 [reviews] INFO: Stopping for res_id: 19845961 as reviews are older than 7 days. 2025-03-31 01:06:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:06:38 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'MumbaiMumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 19855416, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383139, 'download_latency': 0.824087381362915, 'depth': 0} 2025-03-31 01:06:38 [reviews] INFO: Scraped item: {'review': 'Called for Fuoco Pizza and Classico Pizza from here, it was so good. Was delivered with Oregano and Chilli Flakes with Chilli & Olive Oil bottles. It was a good experience. Desipte a delivery set up everything essential was provided, so attention to detail was there and I just loved it. ', 'review_id': 291346409, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'MumbaiMumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 19855416} 2025-03-31 01:06:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19855416&page=1> {'review': 'Called for Fuoco Pizza and Classico Pizza from here, it was so good. Was delivered with Oregano and Chilli Flakes with Chilli & Olive Oil bottles. It was a good experience. Desipte a delivery set up everything essential was provided, so attention to detail was there and I just loved it. ', 'review_id': 291346409, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'MumbaiMumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 19855416} 2025-03-31 01:06:38 [reviews] INFO: Scraped item: {'review': 'The cheesecake had flavour of pasta in it! Horrible experience! Not recommending to anybody', 'review_id': 290055143, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'MumbaiMumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 19855416} 2025-03-31 01:06:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19855416&page=1> {'review': 'The cheesecake had flavour of pasta in it! Horrible experience! Not recommending to anybody', 'review_id': 290055143, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'MumbaiMumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 19855416} 2025-03-31 01:06:38 [reviews] INFO: Scraped item: {'review': '', 'review_id': 289968942, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'MumbaiMumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 19855416} 2025-03-31 01:06:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19855416&page=1> {'review': '', 'review_id': 289968942, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'MumbaiMumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 19855416} 2025-03-31 01:06:38 [reviews] INFO: Stopping for res_id: 19855416 as reviews are older than 7 days. 2025-03-31 01:06:41 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:06:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:06:46 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383145, 'download_latency': 0.68023681640625, 'depth': 0} 2025-03-31 01:06:46 [reviews] INFO: Scraped item: {'review': 'no salt', 'review_id': 291657629, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363} 2025-03-31 01:06:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19856363&page=1> {'review': 'no salt', 'review_id': 291657629, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363} 2025-03-31 01:06:46 [reviews] INFO: Scraped item: {'review': 'Ordered paneer chili. And the paneer tasted absolutely stale. Had three chunks and had to throw most of it away. ', 'review_id': 291408421, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363} 2025-03-31 01:06:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19856363&page=1> {'review': 'Ordered paneer chili. And the paneer tasted absolutely stale. Had three chunks and had to throw most of it away. ', 'review_id': 291408421, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363} 2025-03-31 01:06:46 [reviews] INFO: Scraped item: {'review': 'Not good not even fresh also', 'review_id': 291256633, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363} 2025-03-31 01:06:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19856363&page=1> {'review': 'Not good not even fresh also', 'review_id': 291256633, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363} 2025-03-31 01:06:46 [reviews] INFO: Scraped item: {'review': 'Tasteless!', 'review_id': 291171349, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363} 2025-03-31 01:06:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19856363&page=1> {'review': 'Tasteless!', 'review_id': 291171349, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363} 2025-03-31 01:06:46 [reviews] INFO: Scraped item: {'review': 'worst tasteless food', 'review_id': 290947155, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363} 2025-03-31 01:06:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19856363&page=1> {'review': 'worst tasteless food', 'review_id': 290947155, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363} 2025-03-31 01:06:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:06:49 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383149, 'download_latency': 0.8261842727661133, 'depth': 0} 2025-03-31 01:06:49 [reviews] INFO: Scraped item: {'review': 'Total 5 snall chicken pieces! Its pathetic.', 'review_id': 291504305, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306} 2025-03-31 01:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19894306&page=1> {'review': 'Total 5 snall chicken pieces! Its pathetic.', 'review_id': 291504305, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306} 2025-03-31 01:06:49 [reviews] INFO: Scraped item: {'review': 'according to these test are not gud ..waste of money', 'review_id': 291288063, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306} 2025-03-31 01:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19894306&page=1> {'review': 'according to these test are not gud ..waste of money', 'review_id': 291288063, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306} 2025-03-31 01:06:49 [reviews] INFO: Scraped item: {'review': 'quantity was not as regular ', 'review_id': 290860866, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306} 2025-03-31 01:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19894306&page=1> {'review': 'quantity was not as regular ', 'review_id': 290860866, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306} 2025-03-31 01:06:49 [reviews] INFO: Scraped item: {'review': 'Very bad taste...lots of oil in biryani..its not authentic.', 'review_id': 290606214, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306} 2025-03-31 01:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19894306&page=1> {'review': 'Very bad taste...lots of oil in biryani..its not authentic.', 'review_id': 290606214, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306} 2025-03-31 01:06:49 [reviews] INFO: Stopping for res_id: 19894306 as reviews are older than 7 days. 2025-03-31 01:06:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:06:53 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383153, 'download_latency': 0.8303718566894531, 'depth': 0} 2025-03-31 01:06:53 [reviews] INFO: Scraped item: {'review': '
I recently had the pleasure of visiting Meetha by Radisson, and it was an absolutely delightful experience! From the moment I walked in, I was impressed by the warm ambiance and elegant presentation.

The desserts were simply exceptionalโ€”each bite was a perfect balance of flavors, freshness, and quality. The variety of sweets available was incredible.

The staff was friendly, attentive, and knowledgeable, making sure every guest felt valued. Their recommendations were spot on, and they went above and beyond to provide a fantastic experience.

Overall, Meetha by Radisson is a must-visit for anyone who loves exquisite desserts and top-notch service. I will definitely be returning and highly recommend it to others!
', 'review_id': 291683384, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697} 2025-03-31 01:06:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19931697&page=1> {'review': '
I recently had the pleasure of visiting Meetha by Radisson, and it was an absolutely delightful experience! From the moment I walked in, I was impressed by the warm ambiance and elegant presentation.

The desserts were simply exceptionalโ€”each bite was a perfect balance of flavors, freshness, and quality. The variety of sweets available was incredible.

The staff was friendly, attentive, and knowledgeable, making sure every guest felt valued. Their recommendations were spot on, and they went above and beyond to provide a fantastic experience.

Overall, Meetha by Radisson is a must-visit for anyone who loves exquisite desserts and top-notch service. I will definitely be returning and highly recommend it to others!
', 'review_id': 291683384, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697} 2025-03-31 01:06:53 [reviews] INFO: Scraped item: {'review': ' I ordered kesar kaju katli, rabdi and Assorted meethai box from Meetha by Radisson, and I must say, it was an absolute delight! The quality was top-notch, and the flavors were rich and authentic. also packaging was neat, hygienic and presentable.

Highly recommended for anyone craving premium mithai! Will definitely be ordering again.

Meetha By Radisson', 'review_id': 291677001, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697} 2025-03-31 01:06:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19931697&page=1> {'review': ' I ordered kesar kaju katli, rabdi and Assorted meethai box from Meetha by Radisson, and I must say, it was an absolute delight! The quality was top-notch, and the flavors were rich and authentic. also packaging was neat, hygienic and presentable.

Highly recommended for anyone craving premium mithai! Will definitely be ordering again.

Meetha By Radisson', 'review_id': 291677001, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697} 2025-03-31 01:06:53 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291546460, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697} 2025-03-31 01:06:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19931697&page=1> {'review': '', 'review_id': 291546460, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697} 2025-03-31 01:06:53 [reviews] INFO: Scraped item: {'review': 'Aamras was spoilt', 'review_id': 291500673, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697} 2025-03-31 01:06:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19931697&page=1> {'review': 'Aamras was spoilt', 'review_id': 291500673, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697} 2025-03-31 01:06:53 [reviews] INFO: Scraped item: {'review': 'Mango angoori was delivered stale', 'review_id': 291326230, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697} 2025-03-31 01:06:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19931697&page=1> {'review': 'Mango angoori was delivered stale', 'review_id': 291326230, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697} 2025-03-31 01:06:56 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:07:01 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:07:04 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:07:08 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:07:13 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:07:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:07:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:07:22 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 6 pages/min), scraped 517 items (at 24 items/min) 2025-03-31 01:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-31 01:07:24 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-31 01:07:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:07:27 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:07:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:07:31 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383192, 'download_latency': 3.027721405029297, 'depth': 0} 2025-03-31 01:07:31 [reviews] INFO: Scraped item: {'review': "I used to love biryani by kilo but this time order i can not elaborate how disappointed i was. Biryani was very dry and their is only 2 small chicken pieces in biryani and their is no masala in the biryani it's like eating boiled potato instead of chicken pieces. Biryani is so flavourless it was like the just added salat and just the aroma of spices I was was not abel ro taste any biryani flavour is was just like eating rice and boiled potatoes with salt it's like it was so , pathetic. I don't want to give any star. I suggeste please don't order from biryani by kilo their are many better option then this.", 'review_id': 291259301, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341} 2025-03-31 01:07:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20020341&page=1> {'review': "I used to love biryani by kilo but this time order i can not elaborate how disappointed i was. Biryani was very dry and their is only 2 small chicken pieces in biryani and their is no masala in the biryani it's like eating boiled potato instead of chicken pieces. Biryani is so flavourless it was like the just added salat and just the aroma of spices I was was not abel ro taste any biryani flavour is was just like eating rice and boiled potatoes with salt it's like it was so , pathetic. I don't want to give any star. I suggeste please don't order from biryani by kilo their are many better option then this.", 'review_id': 291259301, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341} 2025-03-31 01:07:31 [reviews] INFO: Scraped item: {'review': 'Worst biryani no taste those time', 'review_id': 291159800, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341} 2025-03-31 01:07:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20020341&page=1> {'review': 'Worst biryani no taste those time', 'review_id': 291159800, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341} 2025-03-31 01:07:31 [reviews] INFO: Scraped item: {'review': '7 pieces instead of 8 as promised in the menu. I am sure the store can count.', 'review_id': 290603971, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341} 2025-03-31 01:07:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20020341&page=1> {'review': '7 pieces instead of 8 as promised in the menu. I am sure the store can count.', 'review_id': 290603971, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341} 2025-03-31 01:07:31 [reviews] INFO: Scraped item: {'review': 'Amazing taste.', 'review_id': 290333452, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341} 2025-03-31 01:07:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20020341&page=1> {'review': 'Amazing taste.', 'review_id': 290333452, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341} 2025-03-31 01:07:31 [reviews] INFO: Scraped item: {'review': 'nice ', 'review_id': 289777281, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341} 2025-03-31 01:07:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20020341&page=1> {'review': 'nice ', 'review_id': 289777281, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341} 2025-03-31 01:07:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:07:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:07:37 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 36, 'brand_name': 'Slay Coffee Bar', 'city': 'Bangalore', 'sub_zone': 'RMZ Millenia', 'platform': 'zomato', 'res_id': 20086621, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383199, 'download_latency': 0.8984184265136719, 'depth': 0} 2025-03-31 01:07:37 [reviews] INFO: Scraped item: {'review': "The restaurant delayed the order by 45 mins to prepare. The coffee came in bland and warm when it was supposed to be 'iced' latte. Pathetic!", 'review_id': 290916070, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 36, 'brand_name': 'Slay Coffee Bar', 'city': 'Bangalore', 'sub_zone': 'RMZ Millenia', 'platform': 'zomato', 'res_id': 20086621} 2025-03-31 01:07:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20086621&page=1> {'review': "The restaurant delayed the order by 45 mins to prepare. The coffee came in bland and warm when it was supposed to be 'iced' latte. Pathetic!", 'review_id': 290916070, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 36, 'brand_name': 'Slay Coffee Bar', 'city': 'Bangalore', 'sub_zone': 'RMZ Millenia', 'platform': 'zomato', 'res_id': 20086621} 2025-03-31 01:07:37 [reviews] INFO: Stopping for res_id: 20086621 as reviews are older than 7 days. 2025-03-31 01:07:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:07:41 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 26, 'brand_name': 'Starbucks Coffee', 'city': 'Bangalore', 'sub_zone': 'Garuda Mall', 'platform': 'zomato', 'res_id': 20214336, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383201, 'download_latency': 0.8262171745300293, 'depth': 0} 2025-03-31 01:07:41 [reviews] INFO: Stopping for res_id: 20214336 as reviews are older than 7 days. 2025-03-31 01:07:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:07:45 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 20227195, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383206, 'download_latency': 0.7531132698059082, 'depth': 0} 2025-03-31 01:07:45 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291592364, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 20227195} 2025-03-31 01:07:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20227195&page=1> {'review': '', 'review_id': 291592364, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 20227195} 2025-03-31 01:07:45 [reviews] INFO: Scraped item: {'review': '', 'review_id': 289669115, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 20227195} 2025-03-31 01:07:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20227195&page=1> {'review': '', 'review_id': 289669115, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 20227195} 2025-03-31 01:07:45 [reviews] INFO: Stopping for res_id: 20227195 as reviews are older than 7 days. 2025-03-31 01:07:48 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:07:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:07:52 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Vikhroli', 'platform': 'zomato', 'res_id': 20248171, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383213, 'download_latency': 1.4171860218048096, 'depth': 0} 2025-03-31 01:07:52 [reviews] ERROR: Unrecognized relative_date format: aug 27, 2023 2025-03-31 01:07:52 [reviews] INFO: Stopping for res_id: 20248171 due to unrecognized date format: Aug 27, 2023. 2025-03-31 01:07:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:07:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:08:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:08:04 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:08:09 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:08:12 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:08:17 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:08:20 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:08:22 [scrapy.extensions.logstats] INFO: Crawled 167 pages (at 5 pages/min), scraped 525 items (at 8 items/min) 2025-03-31 01:08:25 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:08:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:08:29 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 95, 'brand_name': 'Mad Over Donuts', 'city': 'Bangalore', 'sub_zone': 'Marathahalli', 'platform': 'zomato', 'res_id': 20254469, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383252, 'download_latency': 1.0283610820770264, 'depth': 0} 2025-03-31 01:08:29 [reviews] INFO: Stopping for res_id: 20254469 as reviews are older than 7 days. 2025-03-31 01:08:31 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:08:35 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:08:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:08:40 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 32, 'brand_name': 'Third Wave Coffee', 'city': 'Bangalore', 'sub_zone': 'Lavelle Road', 'platform': 'zomato', 'res_id': 20265082, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383262, 'download_latency': 1.0417940616607666, 'depth': 0} 2025-03-31 01:08:40 [reviews] INFO: Stopping for res_id: 20265082 as reviews are older than 7 days. 2025-03-31 01:08:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:08:44 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 20267173, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383266, 'download_latency': 0.880436897277832, 'depth': 0} 2025-03-31 01:08:44 [reviews] INFO: Scraped item: {'review': 'The chicken was very rubbery and chewy. Looks like a last lot of chicken was cooked and served to us. Very bad.', 'review_id': 291025340, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 20267173} 2025-03-31 01:08:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20267173&page=1> {'review': 'The chicken was very rubbery and chewy. Looks like a last lot of chicken was cooked and served to us. Very bad.', 'review_id': 291025340, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 20267173} 2025-03-31 01:08:44 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290615861, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 20267173} 2025-03-31 01:08:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20267173&page=1> {'review': '', 'review_id': 290615861, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 20267173} 2025-03-31 01:08:44 [reviews] INFO: Stopping for res_id: 20267173 as reviews are older than 7 days. 2025-03-31 01:08:47 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:08:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:08:52 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'FUNREPUBLIC MALL', 'platform': 'zomato', 'res_id': 20284206, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383272, 'download_latency': 0.9821734428405762, 'depth': 0} 2025-03-31 01:08:52 [reviews] INFO: Scraped item: {'review': 'utpal and vikas gave good and fast service ', 'review_id': 291674163, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'FUNREPUBLIC MALL', 'platform': 'zomato', 'res_id': 20284206} 2025-03-31 01:08:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20284206&page=1> {'review': 'utpal and vikas gave good and fast service ', 'review_id': 291674163, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'FUNREPUBLIC MALL', 'platform': 'zomato', 'res_id': 20284206} 2025-03-31 01:08:52 [reviews] INFO: Scraped item: {'review': 'very good service by Utpal.', 'review_id': 291657736, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'FUNREPUBLIC MALL', 'platform': 'zomato', 'res_id': 20284206} 2025-03-31 01:08:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20284206&page=1> {'review': 'very good service by Utpal.', 'review_id': 291657736, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'FUNREPUBLIC MALL', 'platform': 'zomato', 'res_id': 20284206} 2025-03-31 01:08:52 [reviews] INFO: Scraped item: {'review': 'nehal senior waiter was very kind and good. food is good and tasty overall a good experience ', 'review_id': 291561443, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'FUNREPUBLIC MALL', 'platform': 'zomato', 'res_id': 20284206} 2025-03-31 01:08:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20284206&page=1> {'review': 'nehal senior waiter was very kind and good. food is good and tasty overall a good experience ', 'review_id': 291561443, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'FUNREPUBLIC MALL', 'platform': 'zomato', 'res_id': 20284206} 2025-03-31 01:08:52 [reviews] INFO: Scraped item: {'review': 'afroz khan- great service!', 'review_id': 291534119, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'FUNREPUBLIC MALL', 'platform': 'zomato', 'res_id': 20284206} 2025-03-31 01:08:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20284206&page=1> {'review': 'afroz khan- great service!', 'review_id': 291534119, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'FUNREPUBLIC MALL', 'platform': 'zomato', 'res_id': 20284206} 2025-03-31 01:08:52 [reviews] INFO: Scraped item: {'review': 'Afroj Khan helped and provided us with good service', 'review_id': 291531695, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'FUNREPUBLIC MALL', 'platform': 'zomato', 'res_id': 20284206} 2025-03-31 01:08:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20284206&page=1> {'review': 'Afroj Khan helped and provided us with good service', 'review_id': 291531695, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'FUNREPUBLIC MALL', 'platform': 'zomato', 'res_id': 20284206} 2025-03-31 01:08:55 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:09:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:09:04 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:09:08 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:09:12 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:09:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:09:17 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Palladium Mall (Lower Parel)', 'platform': 'zomato', 'res_id': 20340568, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383293, 'download_latency': 0.9342341423034668, 'depth': 0} 2025-03-31 01:09:17 [reviews] INFO: Scraped item: {'review': 'The noodles had no chicken in it. the baby corn was reeking of oil smell and was extremely salty. Momos were way too fried to the extent one was burnt', 'review_id': 290264969, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Palladium Mall (Lower Parel)', 'platform': 'zomato', 'res_id': 20340568} 2025-03-31 01:09:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20340568&page=1> {'review': 'The noodles had no chicken in it. the baby corn was reeking of oil smell and was extremely salty. Momos were way too fried to the extent one was burnt', 'review_id': 290264969, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Palladium Mall (Lower Parel)', 'platform': 'zomato', 'res_id': 20340568} 2025-03-31 01:09:17 [reviews] INFO: Stopping for res_id: 20340568 as reviews are older than 7 days. 2025-03-31 01:09:19 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:09:22 [scrapy.extensions.logstats] INFO: Crawled 172 pages (at 5 pages/min), scraped 533 items (at 8 items/min) 2025-03-31 01:09:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:09:24 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383301, 'download_latency': 1.0047335624694824, 'depth': 0} 2025-03-31 01:09:24 [reviews] INFO: Scraped item: {'review': 'There is no chicken in the biryani', 'review_id': 291736642, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424} 2025-03-31 01:09:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20358424&page=1> {'review': 'There is no chicken in the biryani', 'review_id': 291736642, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424} 2025-03-31 01:09:24 [reviews] INFO: Scraped item: {'review': 'Great biryani', 'review_id': 291660018, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424} 2025-03-31 01:09:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20358424&page=1> {'review': 'Great biryani', 'review_id': 291660018, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424} 2025-03-31 01:09:24 [reviews] INFO: Scraped item: {'review': 'Delicious', 'review_id': 291597053, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424} 2025-03-31 01:09:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20358424&page=1> {'review': 'Delicious', 'review_id': 291597053, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424} 2025-03-31 01:09:24 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291595430, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424} 2025-03-31 01:09:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20358424&page=1> {'review': '', 'review_id': 291595430, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424} 2025-03-31 01:09:24 [reviews] INFO: Scraped item: {'review': 'Best biryani ever in Mumbai๐Ÿ˜', 'review_id': 291351137, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424} 2025-03-31 01:09:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20358424&page=1> {'review': 'Best biryani ever in Mumbai๐Ÿ˜', 'review_id': 291351137, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424} 2025-03-31 01:09:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:09:28 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 95, 'brand_name': 'Mad Over Donuts', 'city': 'Bangalore', 'sub_zone': 'Koramangala 7th Block', 'platform': 'zomato', 'res_id': 20360007, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383305, 'download_latency': 0.8209619522094727, 'depth': 0} 2025-03-31 01:09:28 [reviews] INFO: Scraped item: {'review': 'Felt it was not upto the standards I think it was rotten', 'review_id': 290969898, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 95, 'brand_name': 'Mad Over Donuts', 'city': 'Bangalore', 'sub_zone': 'Koramangala 7th Block', 'platform': 'zomato', 'res_id': 20360007} 2025-03-31 01:09:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20360007&page=1> {'review': 'Felt it was not upto the standards I think it was rotten', 'review_id': 290969898, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 95, 'brand_name': 'Mad Over Donuts', 'city': 'Bangalore', 'sub_zone': 'Koramangala 7th Block', 'platform': 'zomato', 'res_id': 20360007} 2025-03-31 01:09:28 [reviews] INFO: Scraped item: {'review': 'The order I got was different from what I had actually ordered. ', 'review_id': 289882887, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 95, 'brand_name': 'Mad Over Donuts', 'city': 'Bangalore', 'sub_zone': 'Koramangala 7th Block', 'platform': 'zomato', 'res_id': 20360007} 2025-03-31 01:09:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20360007&page=1> {'review': 'The order I got was different from what I had actually ordered. ', 'review_id': 289882887, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 95, 'brand_name': 'Mad Over Donuts', 'city': 'Bangalore', 'sub_zone': 'Koramangala 7th Block', 'platform': 'zomato', 'res_id': 20360007} 2025-03-31 01:09:28 [reviews] INFO: Stopping for res_id: 20360007 as reviews are older than 7 days. 2025-03-31 01:09:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:09:31 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 74, 'brand_name': "Good Flippin' Burgers", 'city': 'Gurgaon', 'sub_zone': 'Udyog Vihar', 'platform': 'zomato', 'res_id': 20382650, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383309, 'download_latency': 0.9207005500793457, 'depth': 0} 2025-03-31 01:09:31 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291703501, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 74, 'brand_name': "Good Flippin' Burgers", 'city': 'Gurgaon', 'sub_zone': 'Udyog Vihar', 'platform': 'zomato', 'res_id': 20382650} 2025-03-31 01:09:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20382650&page=1> {'review': '', 'review_id': 291703501, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 74, 'brand_name': "Good Flippin' Burgers", 'city': 'Gurgaon', 'sub_zone': 'Udyog Vihar', 'platform': 'zomato', 'res_id': 20382650} 2025-03-31 01:09:31 [reviews] INFO: Scraped item: {'review': 'Meat seemed old and not fresh...it was chewy, tasteless and the buns were greasy. overall a very poor quality burger that made me sick', 'review_id': 290748779, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 74, 'brand_name': "Good Flippin' Burgers", 'city': 'Gurgaon', 'sub_zone': 'Udyog Vihar', 'platform': 'zomato', 'res_id': 20382650} 2025-03-31 01:09:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20382650&page=1> {'review': 'Meat seemed old and not fresh...it was chewy, tasteless and the buns were greasy. overall a very poor quality burger that made me sick', 'review_id': 290748779, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 74, 'brand_name': "Good Flippin' Burgers", 'city': 'Gurgaon', 'sub_zone': 'Udyog Vihar', 'platform': 'zomato', 'res_id': 20382650} 2025-03-31 01:09:31 [reviews] INFO: Scraped item: {'review': '', 'review_id': 289753822, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 74, 'brand_name': "Good Flippin' Burgers", 'city': 'Gurgaon', 'sub_zone': 'Udyog Vihar', 'platform': 'zomato', 'res_id': 20382650} 2025-03-31 01:09:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20382650&page=1> {'review': '', 'review_id': 289753822, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 74, 'brand_name': "Good Flippin' Burgers", 'city': 'Gurgaon', 'sub_zone': 'Udyog Vihar', 'platform': 'zomato', 'res_id': 20382650} 2025-03-31 01:09:31 [reviews] INFO: Stopping for res_id: 20382650 as reviews are older than 7 days. 2025-03-31 01:09:35 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:09:39 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:09:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:09:44 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383321, 'download_latency': 0.8588862419128418, 'depth': 0} 2025-03-31 01:09:44 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291673569, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081} 2025-03-31 01:09:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20388081&page=1> {'review': '', 'review_id': 291673569, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081} 2025-03-31 01:09:44 [reviews] INFO: Scraped item: {'review': 'Delicious as always! Foo serves the best Oriental fare in town, hands down! ', 'review_id': 291533671, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081} 2025-03-31 01:09:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20388081&page=1> {'review': 'Delicious as always! Foo serves the best Oriental fare in town, hands down! ', 'review_id': 291533671, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081} 2025-03-31 01:09:44 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291533272, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081} 2025-03-31 01:09:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20388081&page=1> {'review': '', 'review_id': 291533272, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081} 2025-03-31 01:09:44 [reviews] INFO: Scraped item: {'review': 'the fried rice was too bland', 'review_id': 289830979, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081} 2025-03-31 01:09:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20388081&page=1> {'review': 'the fried rice was too bland', 'review_id': 289830979, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081} 2025-03-31 01:09:44 [reviews] INFO: Stopping for res_id: 20388081 as reviews are older than 7 days. 2025-03-31 01:09:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:09:46 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 20420004, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383324, 'download_latency': 1.0502464771270752, 'depth': 0} 2025-03-31 01:09:46 [reviews] INFO: Scraped item: {'review': 'worst no masala only yellowish rice
No quantity No quality ', 'review_id': 291180370, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 20420004} 2025-03-31 01:09:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20420004&page=1> {'review': 'worst no masala only yellowish rice
No quantity No quality ', 'review_id': 291180370, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 20420004} 2025-03-31 01:09:46 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291028084, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 20420004} 2025-03-31 01:09:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20420004&page=1> {'review': '', 'review_id': 291028084, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 20420004} 2025-03-31 01:09:46 [reviews] INFO: Scraped item: {'review': 'nice ', 'review_id': 291026808, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 20420004} 2025-03-31 01:09:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20420004&page=1> {'review': 'nice ', 'review_id': 291026808, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 20420004} 2025-03-31 01:09:46 [reviews] INFO: Scraped item: {'review': 'A chicken piece was stale', 'review_id': 291004475, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 20420004} 2025-03-31 01:09:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20420004&page=1> {'review': 'A chicken piece was stale', 'review_id': 291004475, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 20420004} 2025-03-31 01:09:46 [reviews] INFO: Scraped item: {'review': 'gulab jamun is not send', 'review_id': 290970905, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 20420004} 2025-03-31 01:09:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20420004&page=1> {'review': 'gulab jamun is not send', 'review_id': 290970905, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 20420004} 2025-03-31 01:09:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:09:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:09:54 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 31, 'brand_name': 'Twenty Seven Bake House', 'city': 'Mumbai', 'sub_zone': 'Mahalaxmi', 'platform': 'zomato', 'res_id': 20420093, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383332, 'download_latency': 1.351393699645996, 'depth': 0} 2025-03-31 01:09:54 [reviews] INFO: Stopping for res_id: 20420093 as reviews are older than 7 days. 2025-03-31 01:09:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:10:01 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:10:05 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:10:09 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:10:14 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:10:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:10:18 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 87, 'brand_name': 'Sandwizzaa', 'city': 'Mumbai', 'sub_zone': 'Peddar Road', 'platform': 'zomato', 'res_id': 20428971, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383357, 'download_latency': 0.851935625076294, 'depth': 0} 2025-03-31 01:10:18 [reviews] INFO: Scraped item: {'review': 'Sandwich was not toasted properly, all the filling was spilled out of the bread', 'review_id': 291600846, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 87, 'brand_name': 'Sandwizzaa', 'city': 'Mumbai', 'sub_zone': 'Peddar Road', 'platform': 'zomato', 'res_id': 20428971} 2025-03-31 01:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20428971&page=1> {'review': 'Sandwich was not toasted properly, all the filling was spilled out of the bread', 'review_id': 291600846, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 87, 'brand_name': 'Sandwizzaa', 'city': 'Mumbai', 'sub_zone': 'Peddar Road', 'platform': 'zomato', 'res_id': 20428971} 2025-03-31 01:10:18 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290886903, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 87, 'brand_name': 'Sandwizzaa', 'city': 'Mumbai', 'sub_zone': 'Peddar Road', 'platform': 'zomato', 'res_id': 20428971} 2025-03-31 01:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20428971&page=1> {'review': '', 'review_id': 290886903, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 87, 'brand_name': 'Sandwizzaa', 'city': 'Mumbai', 'sub_zone': 'Peddar Road', 'platform': 'zomato', 'res_id': 20428971} 2025-03-31 01:10:18 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290521157, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 87, 'brand_name': 'Sandwizzaa', 'city': 'Mumbai', 'sub_zone': 'Peddar Road', 'platform': 'zomato', 'res_id': 20428971} 2025-03-31 01:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20428971&page=1> {'review': '', 'review_id': 290521157, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 87, 'brand_name': 'Sandwizzaa', 'city': 'Mumbai', 'sub_zone': 'Peddar Road', 'platform': 'zomato', 'res_id': 20428971} 2025-03-31 01:10:18 [reviews] INFO: Scraped item: {'review': 'the sandwich was good but chutney quantity half in both garlic an green chutney', 'review_id': 290347657, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 87, 'brand_name': 'Sandwizzaa', 'city': 'Mumbai', 'sub_zone': 'Peddar Road', 'platform': 'zomato', 'res_id': 20428971} 2025-03-31 01:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20428971&page=1> {'review': 'the sandwich was good but chutney quantity half in both garlic an green chutney', 'review_id': 290347657, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 87, 'brand_name': 'Sandwizzaa', 'city': 'Mumbai', 'sub_zone': 'Peddar Road', 'platform': 'zomato', 'res_id': 20428971} 2025-03-31 01:10:18 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290158244, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 87, 'brand_name': 'Sandwizzaa', 'city': 'Mumbai', 'sub_zone': 'Peddar Road', 'platform': 'zomato', 'res_id': 20428971} 2025-03-31 01:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20428971&page=1> {'review': '', 'review_id': 290158244, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 87, 'brand_name': 'Sandwizzaa', 'city': 'Mumbai', 'sub_zone': 'Peddar Road', 'platform': 'zomato', 'res_id': 20428971} 2025-03-31 01:10:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:10:21 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383360, 'download_latency': 0.8079042434692383, 'depth': 0} 2025-03-31 01:10:21 [reviews] INFO: Scraped item: {'review': 'too much oily and taste was not up to the mark', 'review_id': 291702308, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117} 2025-03-31 01:10:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20440117&page=1> {'review': 'too much oily and taste was not up to the mark', 'review_id': 291702308, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117} 2025-03-31 01:10:21 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291373363, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117} 2025-03-31 01:10:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20440117&page=1> {'review': '', 'review_id': 291373363, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117} 2025-03-31 01:10:21 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291217774, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117} 2025-03-31 01:10:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20440117&page=1> {'review': '', 'review_id': 291217774, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117} 2025-03-31 01:10:21 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291167927, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117} 2025-03-31 01:10:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20440117&page=1> {'review': '', 'review_id': 291167927, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117} 2025-03-31 01:10:21 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290966372, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117} 2025-03-31 01:10:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20440117&page=1> {'review': '', 'review_id': 290966372, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117} 2025-03-31 01:10:22 [scrapy.extensions.logstats] INFO: Crawled 180 pages (at 8 pages/min), scraped 562 items (at 29 items/min) 2025-03-31 01:10:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:10:25 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20448735, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383365, 'download_latency': 0.8489391803741455, 'depth': 0} 2025-03-31 01:10:25 [reviews] INFO: Scraped item: {'review': 'the best in taste n flavour too undoubtedly ', 'review_id': 291183467, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20448735} 2025-03-31 01:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20448735&page=1> {'review': 'the best in taste n flavour too undoubtedly ', 'review_id': 291183467, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20448735} 2025-03-31 01:10:25 [reviews] INFO: Scraped item: {'review': 'Food spillage issue was not resolved', 'review_id': 289781289, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20448735} 2025-03-31 01:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20448735&page=1> {'review': 'Food spillage issue was not resolved', 'review_id': 289781289, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20448735} 2025-03-31 01:10:25 [reviews] INFO: Scraped item: {'review': 'excellent must try', 'review_id': 289690826, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20448735} 2025-03-31 01:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20448735&page=1> {'review': 'excellent must try', 'review_id': 289690826, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20448735} 2025-03-31 01:10:25 [reviews] INFO: Stopping for res_id: 20448735 as reviews are older than 7 days. 2025-03-31 01:10:29 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:10:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:10:33 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 84, 'brand_name': 'Tea Post', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 20492398, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383371, 'download_latency': 0.9236152172088623, 'depth': 0} 2025-03-31 01:10:33 [reviews] INFO: Scraped item: {'review': 'garlic bread quantity was less and it was very hard, difficult to chew ', 'review_id': 291777537, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 84, 'brand_name': 'Tea Post', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 20492398} 2025-03-31 01:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20492398&page=1> {'review': 'garlic bread quantity was less and it was very hard, difficult to chew ', 'review_id': 291777537, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 84, 'brand_name': 'Tea Post', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 20492398} 2025-03-31 01:10:33 [reviews] INFO: Stopping for res_id: 20492398 as reviews are older than 7 days. 2025-03-31 01:10:37 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:10:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:10:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:10:45 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 32, 'brand_name': 'Third Wave Coffee', 'city': 'Mumbai', 'sub_zone': 'Colaba', 'platform': 'zomato', 'res_id': 20509246, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383384, 'download_latency': 1.002190113067627, 'depth': 0} 2025-03-31 01:10:45 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290275290, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 32, 'brand_name': 'Third Wave Coffee', 'city': 'Mumbai', 'sub_zone': 'Colaba', 'platform': 'zomato', 'res_id': 20509246} 2025-03-31 01:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20509246&page=1> {'review': '', 'review_id': 290275290, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 32, 'brand_name': 'Third Wave Coffee', 'city': 'Mumbai', 'sub_zone': 'Colaba', 'platform': 'zomato', 'res_id': 20509246} 2025-03-31 01:10:45 [reviews] INFO: Scraped item: {'review': 'hair in bagel', 'review_id': 290219791, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 32, 'brand_name': 'Third Wave Coffee', 'city': 'Mumbai', 'sub_zone': 'Colaba', 'platform': 'zomato', 'res_id': 20509246} 2025-03-31 01:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20509246&page=1> {'review': 'hair in bagel', 'review_id': 290219791, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 32, 'brand_name': 'Third Wave Coffee', 'city': 'Mumbai', 'sub_zone': 'Colaba', 'platform': 'zomato', 'res_id': 20509246} 2025-03-31 01:10:45 [reviews] INFO: Scraped item: {'review': '', 'review_id': 289606989, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 32, 'brand_name': 'Third Wave Coffee', 'city': 'Mumbai', 'sub_zone': 'Colaba', 'platform': 'zomato', 'res_id': 20509246} 2025-03-31 01:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20509246&page=1> {'review': '', 'review_id': 289606989, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 32, 'brand_name': 'Third Wave Coffee', 'city': 'Mumbai', 'sub_zone': 'Colaba', 'platform': 'zomato', 'res_id': 20509246} 2025-03-31 01:10:45 [reviews] INFO: Stopping for res_id: 20509246 as reviews are older than 7 days. 2025-03-31 01:10:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:10:49 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383387, 'download_latency': 0.9451479911804199, 'depth': 0} 2025-03-31 01:10:49 [reviews] INFO: Scraped item: {'review': "All food was unnecessarily spicy, couldn't taste flavors due to this.
mutton guloti kebab was looking good but taste wasn't great.
I usually love Persian darbar but ramzan special are a bit let down. PD Being onebof my favorites ;tried it multiple times as I couldn't accept the was let down once.", 'review_id': 291629156, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112} 2025-03-31 01:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20516112&page=1> {'review': "All food was unnecessarily spicy, couldn't taste flavors due to this.
mutton guloti kebab was looking good but taste wasn't great.
I usually love Persian darbar but ramzan special are a bit let down. PD Being onebof my favorites ;tried it multiple times as I couldn't accept the was let down once.", 'review_id': 291629156, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112} 2025-03-31 01:10:49 [reviews] INFO: Scraped item: {'review': 'excellent service by Zomato Delivery Boy, excellent job bhai ๐Ÿ™๐Ÿ™๐Ÿ™', 'review_id': 291331889, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112} 2025-03-31 01:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20516112&page=1> {'review': 'excellent service by Zomato Delivery Boy, excellent job bhai ๐Ÿ™๐Ÿ™๐Ÿ™', 'review_id': 291331889, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112} 2025-03-31 01:10:49 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291278755, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112} 2025-03-31 01:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20516112&page=1> {'review': '', 'review_id': 291278755, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112} 2025-03-31 01:10:49 [reviews] INFO: Scraped item: {'review': 'fried rice was sent insted of khabsa rice ', 'review_id': 291233101, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112} 2025-03-31 01:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20516112&page=1> {'review': 'fried rice was sent insted of khabsa rice ', 'review_id': 291233101, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112} 2025-03-31 01:10:49 [reviews] INFO: Scraped item: {'review': 'tasty ', 'review_id': 291170564, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112} 2025-03-31 01:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20516112&page=1> {'review': 'tasty ', 'review_id': 291170564, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112} 2025-03-31 01:10:52 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:10:56 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:11:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:11:04 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:11:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:11:09 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 35, 'brand_name': 'True Black Specialty Coffee', 'city': 'Hyderabad ', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20517056, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383406, 'download_latency': 1.0626096725463867, 'depth': 0} 2025-03-31 01:11:09 [reviews] INFO: Scraped item: {'review': 'I went to this cafe to work on weekends.

There was no a/c working and it was suffocating to sit. Wifi is so poor. The stuff didnโ€™t tell me that a/c not working and no fair wifi connection. They were only concerned about billing.
I ordered a Vietnamese coffee and uber expensive smoothie bowl. Both were ok. Nothing great.

There was no point of lying to a customer about the amenities for money. I called before going there. It was an urgency for me to work from outside my home due to power cut and no wifi.

It was a very bad experience for a cafe which advertises as โ€œwork from cafeโ€ friendly and good food and coffee.

Very expensive place with no good food and facilities.

Never going there again. Waste of time,money and energy!', 'review_id': 291771086, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 35, 'brand_name': 'True Black Specialty Coffee', 'city': 'Hyderabad ', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20517056} 2025-03-31 01:11:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517056&page=1> {'review': 'I went to this cafe to work on weekends.

There was no a/c working and it was suffocating to sit. Wifi is so poor. The stuff didnโ€™t tell me that a/c not working and no fair wifi connection. They were only concerned about billing.
I ordered a Vietnamese coffee and uber expensive smoothie bowl. Both were ok. Nothing great.

There was no point of lying to a customer about the amenities for money. I called before going there. It was an urgency for me to work from outside my home due to power cut and no wifi.

It was a very bad experience for a cafe which advertises as โ€œwork from cafeโ€ friendly and good food and coffee.

Very expensive place with no good food and facilities.

Never going there again. Waste of time,money and energy!', 'review_id': 291771086, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 35, 'brand_name': 'True Black Specialty Coffee', 'city': 'Hyderabad ', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20517056} 2025-03-31 01:11:09 [reviews] INFO: Scraped item: {'review': 'The quantity was very less...an the sauce had spilled...as it was not packed properly', 'review_id': 291628439, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 35, 'brand_name': 'True Black Specialty Coffee', 'city': 'Hyderabad ', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20517056} 2025-03-31 01:11:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517056&page=1> {'review': 'The quantity was very less...an the sauce had spilled...as it was not packed properly', 'review_id': 291628439, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 35, 'brand_name': 'True Black Specialty Coffee', 'city': 'Hyderabad ', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20517056} 2025-03-31 01:11:09 [reviews] INFO: Scraped item: {'review': "the coffee looked like it was made from expired products. I order regularly from True Black and this is the first time i'm so disappointed.", 'review_id': 291462490, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 35, 'brand_name': 'True Black Specialty Coffee', 'city': 'Hyderabad ', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20517056} 2025-03-31 01:11:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517056&page=1> {'review': "the coffee looked like it was made from expired products. I order regularly from True Black and this is the first time i'm so disappointed.", 'review_id': 291462490, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 35, 'brand_name': 'True Black Specialty Coffee', 'city': 'Hyderabad ', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20517056} 2025-03-31 01:11:09 [reviews] INFO: Scraped item: {'review': "I'd heard glowing reviews about this cafe's coffee, so my friends and I decided to finally check it out. We embarked on a caffeine-fueled adventure, sampling a wide variety of their offerings. Each cup proved to be a delightful experience. The Valencia Orange Coffee was a standout, a truly unique and refreshing blend that perfectly balanced citrus and coffee notes โ€“ absolutely amazing! We also indulged in the Peanut Butter Cream Coffee, which was rich and satisfying, a definite treat for peanut butter lovers. And then, there was the unforgettable coffee with brownie... I'm kicking myself for forgetting the name, but the combination of the decadent brownie and expertly brewed coffee was simply divine.
The quality of the coffee itself was undeniable, showcasing a clear dedication to sourcing and brewing exceptional beans. However, the overall ambiance of the restaurant fell short. It felt rather dull and lacking in energy, a stark contrast to the vibrant flavors of the coffee. The lighting was perhaps too subdued, and the decor didn't quite create the warm, inviting atmosphere we were hoping for. While the coffee was certainly worth the visit, I wish the space itself had a bit more life and character.", 'review_id': 289803690, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-25', 'competitor_id': 35, 'brand_name': 'True Black Specialty Coffee', 'city': 'Hyderabad ', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20517056} 2025-03-31 01:11:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517056&page=1> {'review': "I'd heard glowing reviews about this cafe's coffee, so my friends and I decided to finally check it out. We embarked on a caffeine-fueled adventure, sampling a wide variety of their offerings. Each cup proved to be a delightful experience. The Valencia Orange Coffee was a standout, a truly unique and refreshing blend that perfectly balanced citrus and coffee notes โ€“ absolutely amazing! We also indulged in the Peanut Butter Cream Coffee, which was rich and satisfying, a definite treat for peanut butter lovers. And then, there was the unforgettable coffee with brownie... I'm kicking myself for forgetting the name, but the combination of the decadent brownie and expertly brewed coffee was simply divine.
The quality of the coffee itself was undeniable, showcasing a clear dedication to sourcing and brewing exceptional beans. However, the overall ambiance of the restaurant fell short. It felt rather dull and lacking in energy, a stark contrast to the vibrant flavors of the coffee. The lighting was perhaps too subdued, and the decor didn't quite create the warm, inviting atmosphere we were hoping for. While the coffee was certainly worth the visit, I wish the space itself had a bit more life and character.", 'review_id': 289803690, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-25', 'competitor_id': 35, 'brand_name': 'True Black Specialty Coffee', 'city': 'Hyderabad ', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20517056} 2025-03-31 01:11:09 [reviews] INFO: Scraped item: {'review': '', 'review_id': 289613802, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 35, 'brand_name': 'True Black Specialty Coffee', 'city': 'Hyderabad ', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20517056} 2025-03-31 01:11:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517056&page=1> {'review': '', 'review_id': 289613802, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 35, 'brand_name': 'True Black Specialty Coffee', 'city': 'Hyderabad ', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20517056} 2025-03-31 01:11:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:11:13 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383410, 'download_latency': 0.8640761375427246, 'depth': 0} 2025-03-31 01:11:13 [reviews] INFO: Scraped item: {'review': 'very fast delivery ', 'review_id': 291745637, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146} 2025-03-31 01:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517146&page=1> {'review': 'very fast delivery ', 'review_id': 291745637, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146} 2025-03-31 01:11:13 [reviews] INFO: Scraped item: {'review': 'The portions were huge and the taste amazing!', 'review_id': 291572622, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146} 2025-03-31 01:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517146&page=1> {'review': 'The portions were huge and the taste amazing!', 'review_id': 291572622, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146} 2025-03-31 01:11:13 [reviews] INFO: Scraped item: {'review': 'We ordered during Offer period . They gave noodles in soup container', 'review_id': 291318723, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146} 2025-03-31 01:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517146&page=1> {'review': 'We ordered during Offer period . They gave noodles in soup container', 'review_id': 291318723, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146} 2025-03-31 01:11:13 [reviews] INFO: Scraped item: {'review': 'shezwan sauce not added ', 'review_id': 290766411, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146} 2025-03-31 01:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517146&page=1> {'review': 'shezwan sauce not added ', 'review_id': 290766411, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146} 2025-03-31 01:11:13 [reviews] INFO: Scraped item: {'review': 'Not good and test also not like that', 'review_id': 290691642, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146} 2025-03-31 01:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517146&page=1> {'review': 'Not good and test also not like that', 'review_id': 290691642, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146} 2025-03-31 01:11:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:11:17 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 51, 'brand_name': 'Soba Sassy', 'city': 'Kolkata', 'sub_zone': 'Camac Street Area', 'platform': 'zomato', 'res_id': 20528405, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383414, 'download_latency': 1.0130741596221924, 'depth': 0} 2025-03-31 01:11:17 [reviews] INFO: Scraped item: {'review': 'Extraordinary interiors and quite decent price too. Totally worth it. And Must try Crispy Water chestnut it was totally fabbbbbb ', 'review_id': 291533776, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 51, 'brand_name': 'Soba Sassy', 'city': 'Kolkata', 'sub_zone': 'Camac Street Area', 'platform': 'zomato', 'res_id': 20528405} 2025-03-31 01:11:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20528405&page=1> {'review': 'Extraordinary interiors and quite decent price too. Totally worth it. And Must try Crispy Water chestnut it was totally fabbbbbb ', 'review_id': 291533776, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 51, 'brand_name': 'Soba Sassy', 'city': 'Kolkata', 'sub_zone': 'Camac Street Area', 'platform': 'zomato', 'res_id': 20528405} 2025-03-31 01:11:17 [reviews] INFO: Scraped item: {'review': 'Everything was very good', 'review_id': 291529658, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 51, 'brand_name': 'Soba Sassy', 'city': 'Kolkata', 'sub_zone': 'Camac Street Area', 'platform': 'zomato', 'res_id': 20528405} 2025-03-31 01:11:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20528405&page=1> {'review': 'Everything was very good', 'review_id': 291529658, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 51, 'brand_name': 'Soba Sassy', 'city': 'Kolkata', 'sub_zone': 'Camac Street Area', 'platform': 'zomato', 'res_id': 20528405} 2025-03-31 01:11:17 [reviews] INFO: Scraped item: {'review': 'Place is so nice. The serving people and everyone there was so caring. Truly loved the place.', 'review_id': 291523673, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 51, 'brand_name': 'Soba Sassy', 'city': 'Kolkata', 'sub_zone': 'Camac Street Area', 'platform': 'zomato', 'res_id': 20528405} 2025-03-31 01:11:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20528405&page=1> {'review': 'Place is so nice. The serving people and everyone there was so caring. Truly loved the place.', 'review_id': 291523673, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 51, 'brand_name': 'Soba Sassy', 'city': 'Kolkata', 'sub_zone': 'Camac Street Area', 'platform': 'zomato', 'res_id': 20528405} 2025-03-31 01:11:17 [reviews] INFO: Scraped item: {'review': 'The food and ambience was good. But they are all dishonest and stole our personal belongings and when we asked them they denied and said that they didnโ€™t see anything. All frauds.', 'review_id': 291188048, 'rating': '2', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 51, 'brand_name': 'Soba Sassy', 'city': 'Kolkata', 'sub_zone': 'Camac Street Area', 'platform': 'zomato', 'res_id': 20528405} 2025-03-31 01:11:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20528405&page=1> {'review': 'The food and ambience was good. But they are all dishonest and stole our personal belongings and when we asked them they denied and said that they didnโ€™t see anything. All frauds.', 'review_id': 291188048, 'rating': '2', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 51, 'brand_name': 'Soba Sassy', 'city': 'Kolkata', 'sub_zone': 'Camac Street Area', 'platform': 'zomato', 'res_id': 20528405} 2025-03-31 01:11:17 [reviews] INFO: Scraped item: {'review': 'Amazinggggg experienceeee', 'review_id': 290178360, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-26', 'competitor_id': 51, 'brand_name': 'Soba Sassy', 'city': 'Kolkata', 'sub_zone': 'Camac Street Area', 'platform': 'zomato', 'res_id': 20528405} 2025-03-31 01:11:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20528405&page=1> {'review': 'Amazinggggg experienceeee', 'review_id': 290178360, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-26', 'competitor_id': 51, 'brand_name': 'Soba Sassy', 'city': 'Kolkata', 'sub_zone': 'Camac Street Area', 'platform': 'zomato', 'res_id': 20528405} 2025-03-31 01:11:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:11:21 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Veera Desai Area', 'platform': 'zomato', 'res_id': 20541482, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383418, 'download_latency': 0.8622782230377197, 'depth': 0} 2025-03-31 01:11:21 [reviews] INFO: Scraped item: {'review': 'too dry. only rice. only 4 pieces of chicken', 'review_id': 291429850, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Veera Desai Area', 'platform': 'zomato', 'res_id': 20541482} 2025-03-31 01:11:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20541482&page=1> {'review': 'too dry. only rice. only 4 pieces of chicken', 'review_id': 291429850, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Veera Desai Area', 'platform': 'zomato', 'res_id': 20541482} 2025-03-31 01:11:21 [reviews] INFO: Scraped item: {'review': 'Rice was overcooked', 'review_id': 291420959, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Veera Desai Area', 'platform': 'zomato', 'res_id': 20541482} 2025-03-31 01:11:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20541482&page=1> {'review': 'Rice was overcooked', 'review_id': 291420959, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Veera Desai Area', 'platform': 'zomato', 'res_id': 20541482} 2025-03-31 01:11:21 [reviews] INFO: Scraped item: {'review': 'worst haleem I ever had. liquid haleem', 'review_id': 291412727, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Veera Desai Area', 'platform': 'zomato', 'res_id': 20541482} 2025-03-31 01:11:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20541482&page=1> {'review': 'worst haleem I ever had. liquid haleem', 'review_id': 291412727, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Veera Desai Area', 'platform': 'zomato', 'res_id': 20541482} 2025-03-31 01:11:21 [reviews] INFO: Scraped item: {'review': 'taste was not upto mark.. not worth for spending ', 'review_id': 291345268, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Veera Desai Area', 'platform': 'zomato', 'res_id': 20541482} 2025-03-31 01:11:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20541482&page=1> {'review': 'taste was not upto mark.. not worth for spending ', 'review_id': 291345268, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Veera Desai Area', 'platform': 'zomato', 'res_id': 20541482} 2025-03-31 01:11:21 [reviews] INFO: Scraped item: {'review': 'Completely Tasteless and full of couliflowers. Completely Disaster.', 'review_id': 291342189, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Veera Desai Area', 'platform': 'zomato', 'res_id': 20541482} 2025-03-31 01:11:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20541482&page=1> {'review': 'Completely Tasteless and full of couliflowers. Completely Disaster.', 'review_id': 291342189, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Veera Desai Area', 'platform': 'zomato', 'res_id': 20541482} 2025-03-31 01:11:22 [scrapy.extensions.logstats] INFO: Crawled 188 pages (at 8 pages/min), scraped 594 items (at 32 items/min) 2025-03-31 01:11:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:11:28 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:11:31 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:11:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:11:36 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Inorbit Mall', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20587336, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383434, 'download_latency': 1.010094165802002, 'depth': 0} 2025-03-31 01:11:36 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290966586, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Inorbit Mall', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20587336} 2025-03-31 01:11:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20587336&page=1> {'review': '', 'review_id': 290966586, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Inorbit Mall', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20587336} 2025-03-31 01:11:36 [reviews] INFO: Scraped item: {'review': 'Stuffed mushroom was too salty. Other wise taste was very nice', 'review_id': 289880566, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Inorbit Mall', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20587336} 2025-03-31 01:11:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20587336&page=1> {'review': 'Stuffed mushroom was too salty. Other wise taste was very nice', 'review_id': 289880566, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Inorbit Mall', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20587336} 2025-03-31 01:11:36 [reviews] INFO: Stopping for res_id: 20587336 as reviews are older than 7 days. 2025-03-31 01:11:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:11:44 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:11:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:11:48 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 95, 'brand_name': 'Mad Over Donuts', 'city': 'Bangalore', 'sub_zone': 'RT Nagar', 'platform': 'zomato', 'res_id': 20587826, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383446, 'download_latency': 0.9389808177947998, 'depth': 0} 2025-03-31 01:11:48 [reviews] INFO: Scraped item: {'review': 'the cinnaster was really bad. not fresh at all. why would you give an old and hard bread donut to a customer?
Really bad. Next time if a customer is ordering give them fresh cuz we r paying the money over here. no customer should get disappointed like this.', 'review_id': 291160906, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 95, 'brand_name': 'Mad Over Donuts', 'city': 'Bangalore', 'sub_zone': 'RT Nagar', 'platform': 'zomato', 'res_id': 20587826} 2025-03-31 01:11:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20587826&page=1> {'review': 'the cinnaster was really bad. not fresh at all. why would you give an old and hard bread donut to a customer?
Really bad. Next time if a customer is ordering give them fresh cuz we r paying the money over here. no customer should get disappointed like this.', 'review_id': 291160906, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 95, 'brand_name': 'Mad Over Donuts', 'city': 'Bangalore', 'sub_zone': 'RT Nagar', 'platform': 'zomato', 'res_id': 20587826} 2025-03-31 01:11:48 [reviews] INFO: Scraped item: {'review': 'the donuts delivered were old ones and tasted bad', 'review_id': 289730492, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 95, 'brand_name': 'Mad Over Donuts', 'city': 'Bangalore', 'sub_zone': 'RT Nagar', 'platform': 'zomato', 'res_id': 20587826} 2025-03-31 01:11:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20587826&page=1> {'review': 'the donuts delivered were old ones and tasted bad', 'review_id': 289730492, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 95, 'brand_name': 'Mad Over Donuts', 'city': 'Bangalore', 'sub_zone': 'RT Nagar', 'platform': 'zomato', 'res_id': 20587826} 2025-03-31 01:11:48 [reviews] INFO: Stopping for res_id: 20587826 as reviews are older than 7 days. 2025-03-31 01:11:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:11:52 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 20646811, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383450, 'download_latency': 1.1912591457366943, 'depth': 0} 2025-03-31 01:11:52 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290896991, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 20646811} 2025-03-31 01:11:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20646811&page=1> {'review': '', 'review_id': 290896991, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 20646811} 2025-03-31 01:11:52 [reviews] INFO: Scraped item: {'review': 'the macaroni i told to cook soft but it was not cooked had to throw it away. not happy but the pizza was good', 'review_id': 290296581, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 20646811} 2025-03-31 01:11:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20646811&page=1> {'review': 'the macaroni i told to cook soft but it was not cooked had to throw it away. not happy but the pizza was good', 'review_id': 290296581, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 20646811} 2025-03-31 01:11:52 [reviews] INFO: Stopping for res_id: 20646811 as reviews are older than 7 days. 2025-03-31 01:11:55 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:12:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:12:04 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:12:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:12:10 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:12:15 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:12:19 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:12:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:12:22 [scrapy.extensions.logstats] INFO: Crawled 191 pages (at 3 pages/min), scraped 600 items (at 6 items/min) 2025-03-31 01:12:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-31 01:12:23 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-31 01:12:26 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:12:30 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:12:33 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:12:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:12:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:12:44 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:12:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:12:50 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383509, 'download_latency': 1.760436773300171, 'depth': 0} 2025-03-31 01:12:50 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291213497, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045} 2025-03-31 01:12:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20660045&page=1> {'review': '', 'review_id': 291213497, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045} 2025-03-31 01:12:50 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291033135, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045} 2025-03-31 01:12:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20660045&page=1> {'review': '', 'review_id': 291033135, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045} 2025-03-31 01:12:50 [reviews] INFO: Scraped item: {'review': 'very good, very fresh', 'review_id': 291009997, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045} 2025-03-31 01:12:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20660045&page=1> {'review': 'very good, very fresh', 'review_id': 291009997, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045} 2025-03-31 01:12:50 [reviews] INFO: Scraped item: {'review': 'No chutney. No onion. Very dry dry experience', 'review_id': 290794892, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045} 2025-03-31 01:12:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20660045&page=1> {'review': 'No chutney. No onion. Very dry dry experience', 'review_id': 290794892, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045} 2025-03-31 01:12:50 [reviews] INFO: Scraped item: {'review': 'Flavorful biryani , also very kind of them to send 2 extra bowls and spoon without any extra charges great service', 'review_id': 290791781, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045} 2025-03-31 01:12:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20660045&page=1> {'review': 'Flavorful biryani , also very kind of them to send 2 extra bowls and spoon without any extra charges great service', 'review_id': 290791781, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045} 2025-03-31 01:12:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:12:53 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 37, 'brand_name': 'Blue Tokai Coffee Roasters', 'city': 'Bangalore', 'sub_zone': 'Domlur', 'platform': 'zomato', 'res_id': 20661130, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383513, 'download_latency': 0.7004616260528564, 'depth': 0} 2025-03-31 01:12:53 [reviews] INFO: Scraped item: {'review': "I've been ordering this tomato pesto and feta sandwich for a while now, and from the very first bite, it completely blew my mind! Whoever the chef isโ€”you deserve all the hugs and kisses because this sandwich has become my ultimate mood lifter. Even as a non-vegetarian, whenever I'm feeling down, this is my go-to comfort food, and it never fails to lift my spirits. Today was one of those days, and once again, it worked like magic! โœจ Also, love the Blue Tokai packaging! โค๏ธ You guys are amazingโ€”keep up the great work!

", 'review_id': 289774121, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 37, 'brand_name': 'Blue Tokai Coffee Roasters', 'city': 'Bangalore', 'sub_zone': 'Domlur', 'platform': 'zomato', 'res_id': 20661130} 2025-03-31 01:12:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20661130&page=1> {'review': "I've been ordering this tomato pesto and feta sandwich for a while now, and from the very first bite, it completely blew my mind! Whoever the chef isโ€”you deserve all the hugs and kisses because this sandwich has become my ultimate mood lifter. Even as a non-vegetarian, whenever I'm feeling down, this is my go-to comfort food, and it never fails to lift my spirits. Today was one of those days, and once again, it worked like magic! โœจ Also, love the Blue Tokai packaging! โค๏ธ You guys are amazingโ€”keep up the great work!

", 'review_id': 289774121, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 37, 'brand_name': 'Blue Tokai Coffee Roasters', 'city': 'Bangalore', 'sub_zone': 'Domlur', 'platform': 'zomato', 'res_id': 20661130} 2025-03-31 01:12:53 [reviews] INFO: Stopping for res_id: 20661130 as reviews are older than 7 days. 2025-03-31 01:12:56 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:12:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:13:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:13:05 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:13:09 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:13:12 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:13:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:13:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:13:22 [scrapy.extensions.logstats] INFO: Crawled 193 pages (at 2 pages/min), scraped 606 items (at 6 items/min) 2025-03-31 01:13:23 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:13:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:13:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:13:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:13:39 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:13:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:13:48 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383565, 'download_latency': 4.036496639251709, 'depth': 0} 2025-03-31 01:13:48 [reviews] INFO: Scraped item: {'review': 'Felt cheated, they offered us complimentary shots which were pricey and later billed', 'review_id': 291754592, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565} 2025-03-31 01:13:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20667565&page=1> {'review': 'Felt cheated, they offered us complimentary shots which were pricey and later billed', 'review_id': 291754592, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565} 2025-03-31 01:13:48 [reviews] INFO: Scraped item: {'review': 'Hands down, the best dim sums Iโ€™ve ever had! The Lobster & Scallop Dumplings had a very unique taste. The cocktails were also expertly made. Great place for a night out!', 'review_id': 291025998, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-29', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565} 2025-03-31 01:13:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20667565&page=1> {'review': 'Hands down, the best dim sums Iโ€™ve ever had! The Lobster & Scallop Dumplings had a very unique taste. The cocktails were also expertly made. Great place for a night out!', 'review_id': 291025998, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-29', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565} 2025-03-31 01:13:48 [reviews] INFO: Scraped item: {'review': 'A perfect restaurant for foodies! They have very unique dishes. The Avocado Sensei Sushi Roll was delicious, and the Yazu Signature Sichuan Garlic Prawn had the right balance of spice. A wonderful dining experience overall.', 'review_id': 291025748, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-29', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565} 2025-03-31 01:13:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20667565&page=1> {'review': 'A perfect restaurant for foodies! They have very unique dishes. The Avocado Sensei Sushi Roll was delicious, and the Yazu Signature Sichuan Garlic Prawn had the right balance of spice. A wonderful dining experience overall.', 'review_id': 291025748, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-29', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565} 2025-03-31 01:13:48 [reviews] INFO: Scraped item: {'review': 'Crowd & environment was awesome..
Their services was top notch...
Frankly speaking I loved it.', 'review_id': 290845736, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-28', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565} 2025-03-31 01:13:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20667565&page=1> {'review': 'Crowd & environment was awesome..
Their services was top notch...
Frankly speaking I loved it.', 'review_id': 290845736, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-28', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565} 2025-03-31 01:13:48 [reviews] INFO: Scraped item: {'review': 'Great atmosphere, very pleased! Enjoyed talking with our waitress. Love being able to leave our artwork on the table!', 'review_id': 290833946, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-28', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565} 2025-03-31 01:13:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20667565&page=1> {'review': 'Great atmosphere, very pleased! Enjoyed talking with our waitress. Love being able to leave our artwork on the table!', 'review_id': 290833946, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-28', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565} 2025-03-31 01:13:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:13:50 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 47, 'brand_name': 'ASIE', 'city': 'Hyderabad', 'sub_zone': 'Gachibowli', 'platform': 'zomato', 'res_id': 20682991, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383571, 'download_latency': 1.631091833114624, 'depth': 0} 2025-03-31 01:13:50 [reviews] INFO: Scraped item: {'review': 'Burnt food', 'review_id': 291631432, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 47, 'brand_name': 'ASIE', 'city': 'Hyderabad', 'sub_zone': 'Gachibowli', 'platform': 'zomato', 'res_id': 20682991} 2025-03-31 01:13:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20682991&page=1> {'review': 'Burnt food', 'review_id': 291631432, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 47, 'brand_name': 'ASIE', 'city': 'Hyderabad', 'sub_zone': 'Gachibowli', 'platform': 'zomato', 'res_id': 20682991} 2025-03-31 01:13:50 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291184301, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 47, 'brand_name': 'ASIE', 'city': 'Hyderabad', 'sub_zone': 'Gachibowli', 'platform': 'zomato', 'res_id': 20682991} 2025-03-31 01:13:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20682991&page=1> {'review': '', 'review_id': 291184301, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 47, 'brand_name': 'ASIE', 'city': 'Hyderabad', 'sub_zone': 'Gachibowli', 'platform': 'zomato', 'res_id': 20682991} 2025-03-31 01:13:50 [reviews] INFO: Scraped item: {'review': 'Restaurant cheated under the name of โ€œCarnivalโ€ offer. They serve smaller portions which we were not informed of on the District app, or by any of the server. The Manager tried to come up with excuses, going to the length saying โ€œwe cannot serve full portion for.', 'review_id': 290988705, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-29', 'competitor_id': 47, 'brand_name': 'ASIE', 'city': 'Hyderabad', 'sub_zone': 'Gachibowli', 'platform': 'zomato', 'res_id': 20682991} 2025-03-31 01:13:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20682991&page=1> {'review': 'Restaurant cheated under the name of โ€œCarnivalโ€ offer. They serve smaller portions which we were not informed of on the District app, or by any of the server. The Manager tried to come up with excuses, going to the length saying โ€œwe cannot serve full portion for.', 'review_id': 290988705, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-29', 'competitor_id': 47, 'brand_name': 'ASIE', 'city': 'Hyderabad', 'sub_zone': 'Gachibowli', 'platform': 'zomato', 'res_id': 20682991} 2025-03-31 01:13:50 [reviews] INFO: Scraped item: {'review': 'Did not get the egg in the dish', 'review_id': 290951700, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 47, 'brand_name': 'ASIE', 'city': 'Hyderabad', 'sub_zone': 'Gachibowli', 'platform': 'zomato', 'res_id': 20682991} 2025-03-31 01:13:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20682991&page=1> {'review': 'Did not get the egg in the dish', 'review_id': 290951700, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 47, 'brand_name': 'ASIE', 'city': 'Hyderabad', 'sub_zone': 'Gachibowli', 'platform': 'zomato', 'res_id': 20682991} 2025-03-31 01:13:50 [reviews] INFO: Scraped item: {'review': 'Vegetarian food smells like egg', 'review_id': 290763187, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 47, 'brand_name': 'ASIE', 'city': 'Hyderabad', 'sub_zone': 'Gachibowli', 'platform': 'zomato', 'res_id': 20682991} 2025-03-31 01:13:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20682991&page=1> {'review': 'Vegetarian food smells like egg', 'review_id': 290763187, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 47, 'brand_name': 'ASIE', 'city': 'Hyderabad', 'sub_zone': 'Gachibowli', 'platform': 'zomato', 'res_id': 20682991} 2025-03-31 01:13:51 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:13:55 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:13:59 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:14:03 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:14:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:14:09 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 3, 'brand_name': 'JuCo Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 20789516, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383586, 'download_latency': 2.283783197402954, 'depth': 0} 2025-03-31 01:14:09 [reviews] INFO: Scraped item: {'review': 'The wrap is DRENCHED in SO MUCH OIL!!!', 'review_id': 291645489, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 3, 'brand_name': 'JuCo Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 20789516} 2025-03-31 01:14:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20789516&page=1> {'review': 'The wrap is DRENCHED in SO MUCH OIL!!!', 'review_id': 291645489, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 3, 'brand_name': 'JuCo Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 20789516} 2025-03-31 01:14:09 [reviews] INFO: Scraped item: {'review': 'over priced. ordered berry bowl...680 rs...no reason for such a high price. hugely over priced', 'review_id': 291602546, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 3, 'brand_name': 'JuCo Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 20789516} 2025-03-31 01:14:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20789516&page=1> {'review': 'over priced. ordered berry bowl...680 rs...no reason for such a high price. hugely over priced', 'review_id': 291602546, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 3, 'brand_name': 'JuCo Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 20789516} 2025-03-31 01:14:09 [reviews] INFO: Stopping for res_id: 20789516 as reviews are older than 7 days. 2025-03-31 01:14:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:14:12 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 75, 'brand_name': 'Louis Burger', 'city': 'Gurgaon', 'sub_zone': 'Udyog Vihar', 'platform': 'zomato', 'res_id': 20801316, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383590, 'download_latency': 1.1105620861053467, 'depth': 0} 2025-03-31 01:14:12 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290846006, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 75, 'brand_name': 'Louis Burger', 'city': 'Gurgaon', 'sub_zone': 'Udyog Vihar', 'platform': 'zomato', 'res_id': 20801316} 2025-03-31 01:14:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20801316&page=1> {'review': '', 'review_id': 290846006, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 75, 'brand_name': 'Louis Burger', 'city': 'Gurgaon', 'sub_zone': 'Udyog Vihar', 'platform': 'zomato', 'res_id': 20801316} 2025-03-31 01:14:12 [reviews] INFO: Scraped item: {'review': "Don't know whether the burger was stale or what, but I suffered food poisoning after having their burger. I am scared of ordering from them again.", 'review_id': 290373039, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 75, 'brand_name': 'Louis Burger', 'city': 'Gurgaon', 'sub_zone': 'Udyog Vihar', 'platform': 'zomato', 'res_id': 20801316} 2025-03-31 01:14:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20801316&page=1> {'review': "Don't know whether the burger was stale or what, but I suffered food poisoning after having their burger. I am scared of ordering from them again.", 'review_id': 290373039, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 75, 'brand_name': 'Louis Burger', 'city': 'Gurgaon', 'sub_zone': 'Udyog Vihar', 'platform': 'zomato', 'res_id': 20801316} 2025-03-31 01:14:12 [reviews] INFO: Scraped item: {'review': 'Poor quantity as compared to what we used to get with Louis. They have significantly reduced the quantity of the peri peri fries. Despite complaining to their local kitchens and managers the stroy remains the same. Im paying 500 for 2 peri peri fries and I recieve half the quantity. Pathetic.', 'review_id': 290369634, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 75, 'brand_name': 'Louis Burger', 'city': 'Gurgaon', 'sub_zone': 'Udyog Vihar', 'platform': 'zomato', 'res_id': 20801316} 2025-03-31 01:14:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20801316&page=1> {'review': 'Poor quantity as compared to what we used to get with Louis. They have significantly reduced the quantity of the peri peri fries. Despite complaining to their local kitchens and managers the stroy remains the same. Im paying 500 for 2 peri peri fries and I recieve half the quantity. Pathetic.', 'review_id': 290369634, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 75, 'brand_name': 'Louis Burger', 'city': 'Gurgaon', 'sub_zone': 'Udyog Vihar', 'platform': 'zomato', 'res_id': 20801316} 2025-03-31 01:14:12 [reviews] INFO: Stopping for res_id: 20801316 as reviews are older than 7 days. 2025-03-31 01:14:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:14:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:14:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:14:22 [scrapy.extensions.logstats] INFO: Crawled 197 pages (at 4 pages/min), scraped 621 items (at 15 items/min) 2025-03-31 01:14:26 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:14:30 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:14:33 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:14:37 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:14:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:14:42 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Ahmedabad ', 'sub_zone': 'Palladium Mall', 'platform': 'zomato', 'res_id': 20816697, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383620, 'download_latency': 1.5016038417816162, 'depth': 0} 2025-03-31 01:14:42 [reviews] INFO: Scraped item: {'review': 'The food and ambience is very nice. We were very happy with the services of Mr Darshan, he recommended and served us really good', 'review_id': 291637302, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Ahmedabad ', 'sub_zone': 'Palladium Mall', 'platform': 'zomato', 'res_id': 20816697} 2025-03-31 01:14:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20816697&page=1> {'review': 'The food and ambience is very nice. We were very happy with the services of Mr Darshan, he recommended and served us really good', 'review_id': 291637302, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Ahmedabad ', 'sub_zone': 'Palladium Mall', 'platform': 'zomato', 'res_id': 20816697} 2025-03-31 01:14:42 [reviews] INFO: Scraped item: {'review': 'Great quality and taste of food, great ambiance, very good service and recommendations by Mr.Darshan. Highly appreciate and recommend this place for authentic asian food.', 'review_id': 290320348, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-27', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Ahmedabad ', 'sub_zone': 'Palladium Mall', 'platform': 'zomato', 'res_id': 20816697} 2025-03-31 01:14:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20816697&page=1> {'review': 'Great quality and taste of food, great ambiance, very good service and recommendations by Mr.Darshan. Highly appreciate and recommend this place for authentic asian food.', 'review_id': 290320348, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-27', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Ahmedabad ', 'sub_zone': 'Palladium Mall', 'platform': 'zomato', 'res_id': 20816697} 2025-03-31 01:14:42 [reviews] INFO: Stopping for res_id: 20816697 as reviews are older than 7 days. 2025-03-31 01:14:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:14:46 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20828825, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383628, 'download_latency': 1.4210424423217773, 'depth': 0} 2025-03-31 01:14:46 [reviews] INFO: Scraped item: {'review': 'Too Soggy, and Cold', 'review_id': 291741347, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20828825} 2025-03-31 01:14:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20828825&page=1> {'review': 'Too Soggy, and Cold', 'review_id': 291741347, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20828825} 2025-03-31 01:14:46 [reviews] INFO: Scraped item: {'review': 'The garlic bread was so tasty, it was amazing and the quality was good , portion size was generous. must try', 'review_id': 290023448, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20828825} 2025-03-31 01:14:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20828825&page=1> {'review': 'The garlic bread was so tasty, it was amazing and the quality was good , portion size was generous. must try', 'review_id': 290023448, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20828825} 2025-03-31 01:14:46 [reviews] INFO: Scraped item: {'review': 'Nutella cheesecake was so so yummy and delicious, it was flavourful, tasty and scrumptious, well delivered with a properly packed container, loved each bite, so tasty, Highly recommended ', 'review_id': 289979827, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20828825} 2025-03-31 01:14:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20828825&page=1> {'review': 'Nutella cheesecake was so so yummy and delicious, it was flavourful, tasty and scrumptious, well delivered with a properly packed container, loved each bite, so tasty, Highly recommended ', 'review_id': 289979827, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20828825} 2025-03-31 01:14:46 [reviews] INFO: Scraped item: {'review': 'ordered the jain Margherita pizza from here, the taste was super good and delicious, the quality and portions were amazing, each bite tasted amazing. loved it ', 'review_id': 289948269, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20828825} 2025-03-31 01:14:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20828825&page=1> {'review': 'ordered the jain Margherita pizza from here, the taste was super good and delicious, the quality and portions were amazing, each bite tasted amazing. loved it ', 'review_id': 289948269, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20828825} 2025-03-31 01:14:46 [reviews] INFO: Stopping for res_id: 20828825 as reviews are older than 7 days. 2025-03-31 01:14:47 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:14:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:14:55 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:14:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:15:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:15:06 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:15:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:15:12 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383652, 'download_latency': 1.392869234085083, 'depth': 0} 2025-03-31 01:15:12 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291328014, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186} 2025-03-31 01:15:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20844186&page=1> {'review': '', 'review_id': 291328014, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186} 2025-03-31 01:15:12 [reviews] INFO: Scraped item: {'review': 'Worst biryani', 'review_id': 291167274, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186} 2025-03-31 01:15:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20844186&page=1> {'review': 'Worst biryani', 'review_id': 291167274, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186} 2025-03-31 01:15:12 [reviews] INFO: Scraped item: {'review': 'Food was good and service was excellent by Somu', 'review_id': 291155437, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186} 2025-03-31 01:15:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20844186&page=1> {'review': 'Food was good and service was excellent by Somu', 'review_id': 291155437, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186} 2025-03-31 01:15:12 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291009808, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186} 2025-03-31 01:15:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20844186&page=1> {'review': '', 'review_id': 291009808, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186} 2025-03-31 01:15:12 [reviews] INFO: Scraped item: {'review': 'Balram was a good host. Recommended', 'review_id': 290869500, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-29', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186} 2025-03-31 01:15:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20844186&page=1> {'review': 'Balram was a good host. Recommended', 'review_id': 290869500, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-29', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186} 2025-03-31 01:15:15 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:15:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:15:21 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:15:22 [scrapy.extensions.logstats] INFO: Crawled 200 pages (at 3 pages/min), scraped 632 items (at 11 items/min) 2025-03-31 01:15:25 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:15:29 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:15:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:15:36 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:15:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:15:41 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383682, 'download_latency': 1.589653491973877, 'depth': 0} 2025-03-31 01:15:41 [reviews] INFO: Scraped item: {'review': 'thalairaj biryani is very good ', 'review_id': 291645896, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681} 2025-03-31 01:15:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20880681&page=1> {'review': 'thalairaj biryani is very good ', 'review_id': 291645896, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681} 2025-03-31 01:15:41 [reviews] INFO: Scraped item: {'review': 'Good food and very nice and fast service', 'review_id': 291413578, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681} 2025-03-31 01:15:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20880681&page=1> {'review': 'Good food and very nice and fast service', 'review_id': 291413578, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681} 2025-03-31 01:15:41 [reviews] INFO: Scraped item: {'review': 'You made me crazy with your awesome taste.
Loving the food you are serving ', 'review_id': 290674995, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681} 2025-03-31 01:15:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20880681&page=1> {'review': 'You made me crazy with your awesome taste.
Loving the food you are serving ', 'review_id': 290674995, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681} 2025-03-31 01:15:41 [reviews] INFO: Scraped item: {'review': 'fried chicken is good', 'review_id': 290526752, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681} 2025-03-31 01:15:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20880681&page=1> {'review': 'fried chicken is good', 'review_id': 290526752, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681} 2025-03-31 01:15:41 [reviews] INFO: Scraped item: {'review': 'Burnt food', 'review_id': 290363459, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681} 2025-03-31 01:15:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20880681&page=1> {'review': 'Burnt food', 'review_id': 290363459, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681} 2025-03-31 01:15:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:15:45 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 3, 'brand_name': 'Achija', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 20895131, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383686, 'download_latency': 1.1214048862457275, 'depth': 0} 2025-03-31 01:15:45 [reviews] INFO: Scraped item: {'review': 'today food quality is not good
', 'review_id': 291643071, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 3, 'brand_name': 'Achija', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 20895131} 2025-03-31 01:15:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20895131&page=1> {'review': 'today food quality is not good
', 'review_id': 291643071, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 3, 'brand_name': 'Achija', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 20895131} 2025-03-31 01:15:45 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291381210, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 3, 'brand_name': 'Achija', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 20895131} 2025-03-31 01:15:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20895131&page=1> {'review': '', 'review_id': 291381210, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 3, 'brand_name': 'Achija', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 20895131} 2025-03-31 01:15:45 [reviews] INFO: Stopping for res_id: 20895131 as reviews are older than 7 days. 2025-03-31 01:15:48 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:15:52 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:15:56 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:16:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:16:04 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:16:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:16:10 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383707, 'download_latency': 1.4802274703979492, 'depth': 0} 2025-03-31 01:16:10 [reviews] INFO: Scraped item: {'review': 'Shitty place. Have no humanity. Cant serve some snack while waiting even for a pregnant lady. Forget that they didnt have the humanity to serve water when asked for.', 'review_id': 291316010, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097} 2025-03-31 01:16:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20896097&page=1> {'review': 'Shitty place. Have no humanity. Cant serve some snack while waiting even for a pregnant lady. Forget that they didnt have the humanity to serve water when asked for.', 'review_id': 291316010, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097} 2025-03-31 01:16:10 [reviews] INFO: Scraped item: {'review': 'This place is really nice to order tasty food, recently i ordered pasta from here.
Packaging was too good. Taste was also awesome', 'review_id': 291185002, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097} 2025-03-31 01:16:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20896097&page=1> {'review': 'This place is really nice to order tasty food, recently i ordered pasta from here.
Packaging was too good. Taste was also awesome', 'review_id': 291185002, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097} 2025-03-31 01:16:10 [reviews] INFO: Scraped item: {'review': '
My cravings was satisfied and i must say there was no compromise with quality.
Must try this outlet.', 'review_id': 291166794, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097} 2025-03-31 01:16:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20896097&page=1> {'review': '
My cravings was satisfied and i must say there was no compromise with quality.
Must try this outlet.', 'review_id': 291166794, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097} 2025-03-31 01:16:10 [reviews] INFO: Scraped item: {'review': 'It was looking tempting. nicely prepared with spices and had good portion of food. Superb in taste, loved it.', 'review_id': 291166697, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097} 2025-03-31 01:16:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20896097&page=1> {'review': 'It was looking tempting. nicely prepared with spices and had good portion of food. Superb in taste, loved it.', 'review_id': 291166697, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097} 2025-03-31 01:16:10 [reviews] INFO: Scraped item: {'review': 'I tried makhan pav bhaji from here. It was very yummy and the quality of the food was also amazing', 'review_id': 291166561, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097} 2025-03-31 01:16:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20896097&page=1> {'review': 'I tried makhan pav bhaji from here. It was very yummy and the quality of the food was also amazing', 'review_id': 291166561, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097} 2025-03-31 01:16:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:16:13 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 93, 'brand_name': 'Mumbai Bites', 'city': 'Mumbai', 'sub_zone': 'Ghatkopar', 'platform': 'zomato', 'res_id': 20899217, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383712, 'download_latency': 1.370729684829712, 'depth': 0} 2025-03-31 01:16:13 [reviews] INFO: Scraped item: {'review': 'The noodles were ok but the Triple Rice was absolutely useless as the Schezwan Rice which is available on the streets for Rs. 40 is tastier than this in taste and the quantity was also very less in comparison to the price.', 'review_id': 291773896, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 93, 'brand_name': 'Mumbai Bites', 'city': 'Mumbai', 'sub_zone': 'Ghatkopar', 'platform': 'zomato', 'res_id': 20899217} 2025-03-31 01:16:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20899217&page=1> {'review': 'The noodles were ok but the Triple Rice was absolutely useless as the Schezwan Rice which is available on the streets for Rs. 40 is tastier than this in taste and the quantity was also very less in comparison to the price.', 'review_id': 291773896, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 93, 'brand_name': 'Mumbai Bites', 'city': 'Mumbai', 'sub_zone': 'Ghatkopar', 'platform': 'zomato', 'res_id': 20899217} 2025-03-31 01:16:13 [reviews] INFO: Scraped item: {'review': 'Cold drink received was just 200 ml instead of 500 ml', 'review_id': 291614988, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 93, 'brand_name': 'Mumbai Bites', 'city': 'Mumbai', 'sub_zone': 'Ghatkopar', 'platform': 'zomato', 'res_id': 20899217} 2025-03-31 01:16:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20899217&page=1> {'review': 'Cold drink received was just 200 ml instead of 500 ml', 'review_id': 291614988, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 93, 'brand_name': 'Mumbai Bites', 'city': 'Mumbai', 'sub_zone': 'Ghatkopar', 'platform': 'zomato', 'res_id': 20899217} 2025-03-31 01:16:13 [reviews] INFO: Scraped item: {'review': 'Oily and sticky rice and schezwan chutney was stale and smelling', 'review_id': 291568764, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 93, 'brand_name': 'Mumbai Bites', 'city': 'Mumbai', 'sub_zone': 'Ghatkopar', 'platform': 'zomato', 'res_id': 20899217} 2025-03-31 01:16:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20899217&page=1> {'review': 'Oily and sticky rice and schezwan chutney was stale and smelling', 'review_id': 291568764, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 93, 'brand_name': 'Mumbai Bites', 'city': 'Mumbai', 'sub_zone': 'Ghatkopar', 'platform': 'zomato', 'res_id': 20899217} 2025-03-31 01:16:13 [reviews] INFO: Scraped item: {'review': 'very small size soup, avoid', 'review_id': 291260587, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 93, 'brand_name': 'Mumbai Bites', 'city': 'Mumbai', 'sub_zone': 'Ghatkopar', 'platform': 'zomato', 'res_id': 20899217} 2025-03-31 01:16:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20899217&page=1> {'review': 'very small size soup, avoid', 'review_id': 291260587, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 93, 'brand_name': 'Mumbai Bites', 'city': 'Mumbai', 'sub_zone': 'Ghatkopar', 'platform': 'zomato', 'res_id': 20899217} 2025-03-31 01:16:13 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290625098, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 93, 'brand_name': 'Mumbai Bites', 'city': 'Mumbai', 'sub_zone': 'Ghatkopar', 'platform': 'zomato', 'res_id': 20899217} 2025-03-31 01:16:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20899217&page=1> {'review': '', 'review_id': 290625098, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 93, 'brand_name': 'Mumbai Bites', 'city': 'Mumbai', 'sub_zone': 'Ghatkopar', 'platform': 'zomato', 'res_id': 20899217} 2025-03-31 01:16:15 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:16:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:16:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:16:22 [scrapy.extensions.logstats] INFO: Crawled 204 pages (at 4 pages/min), scraped 649 items (at 17 items/min) 2025-03-31 01:16:26 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:16:29 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:16:32 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:16:36 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:16:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:16:40 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383741, 'download_latency': 1.1865241527557373, 'depth': 0} 2025-03-31 01:16:40 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291623017, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523} 2025-03-31 01:16:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20907523&page=1> {'review': '', 'review_id': 291623017, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523} 2025-03-31 01:16:40 [reviews] INFO: Scraped item: {'review': 'The quantity of food in the restaurant is more of rice especially than in order', 'review_id': 291604173, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523} 2025-03-31 01:16:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20907523&page=1> {'review': 'The quantity of food in the restaurant is more of rice especially than in order', 'review_id': 291604173, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523} 2025-03-31 01:16:40 [reviews] INFO: Scraped item: {'review': 'This is the 3rd time this is happening with us. We go there for dinner because food taste is realy nice but when we come back our stomach is too upset. Once and twice we ignored thinking this would be just like that but this happened the 3rd time as well.
I am sure I wont be going to this place now. My whole family suffered!', 'review_id': 290728319, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-28', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523} 2025-03-31 01:16:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20907523&page=1> {'review': 'This is the 3rd time this is happening with us. We go there for dinner because food taste is realy nice but when we come back our stomach is too upset. Once and twice we ignored thinking this would be just like that but this happened the 3rd time as well.
I am sure I wont be going to this place now. My whole family suffered!', 'review_id': 290728319, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-28', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523} 2025-03-31 01:16:40 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290722926, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523} 2025-03-31 01:16:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20907523&page=1> {'review': '', 'review_id': 290722926, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523} 2025-03-31 01:16:40 [reviews] INFO: Scraped item: {'review': 'Food qty is very less for the high prices charged. It is rip off.', 'review_id': 290535992, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523} 2025-03-31 01:16:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20907523&page=1> {'review': 'Food qty is very less for the high prices charged. It is rip off.', 'review_id': 290535992, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523} 2025-03-31 01:16:43 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:16:47 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:16:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:16:52 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:16:56 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:17:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:17:01 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 96, 'brand_name': "Dunkin' - Donuts & Coffee", 'city': 'Bangalore', 'sub_zone': 'Old Madras Road', 'platform': 'zomato', 'res_id': 20971932, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383765, 'download_latency': 1.2737159729003906, 'depth': 0} 2025-03-31 01:17:01 [reviews] INFO: Stopping for res_id: 20971932 as reviews are older than 7 days. 2025-03-31 01:17:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:17:05 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383770, 'download_latency': 1.4749572277069092, 'depth': 0} 2025-03-31 01:17:05 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291550807, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125} 2025-03-31 01:17:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20998125&page=1> {'review': '', 'review_id': 291550807, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125} 2025-03-31 01:17:05 [reviews] INFO: Scraped item: {'review': 'Really good ambience with delicious authentic japanese food. Quick service with polite staff. Would definitely visit again', 'review_id': 291298707, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125} 2025-03-31 01:17:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20998125&page=1> {'review': 'Really good ambience with delicious authentic japanese food. Quick service with polite staff. Would definitely visit again', 'review_id': 291298707, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125} 2025-03-31 01:17:05 [reviews] INFO: Scraped item: {'review': 'Great service. Shoutout to Anil!', 'review_id': 291275939, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125} 2025-03-31 01:17:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20998125&page=1> {'review': 'Great service. Shoutout to Anil!', 'review_id': 291275939, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125} 2025-03-31 01:17:05 [reviews] INFO: Scraped item: {'review': 'Anil provided a great service and had the warmest behaviour', 'review_id': 291206770, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125} 2025-03-31 01:17:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20998125&page=1> {'review': 'Anil provided a great service and had the warmest behaviour', 'review_id': 291206770, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125} 2025-03-31 01:17:05 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290979429, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125} 2025-03-31 01:17:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20998125&page=1> {'review': '', 'review_id': 290979429, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125} 2025-03-31 01:17:08 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:17:11 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:17:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:17:16 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:17:19 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:17:22 [scrapy.extensions.logstats] INFO: Crawled 207 pages (at 3 pages/min), scraped 659 items (at 10 items/min) 2025-03-31 01:17:23 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:17:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-31 01:17:23 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-31 01:17:27 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:17:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:17:32 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 48, 'brand_name': 'Sakura - A Far Eastern Kitchen', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 21012857, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383796, 'download_latency': 1.520240306854248, 'depth': 0} 2025-03-31 01:17:32 [reviews] INFO: Scraped item: {'review': 'Srikanth was very polite and made us feel very welcomed. The food was also really good
', 'review_id': 291659062, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 48, 'brand_name': 'Sakura - A Far Eastern Kitchen', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 21012857} 2025-03-31 01:17:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21012857&page=1> {'review': 'Srikanth was very polite and made us feel very welcomed. The food was also really good
', 'review_id': 291659062, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 48, 'brand_name': 'Sakura - A Far Eastern Kitchen', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 21012857} 2025-03-31 01:17:32 [reviews] INFO: Scraped item: {'review': 'Really disappointed food', 'review_id': 291276816, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 48, 'brand_name': 'Sakura - A Far Eastern Kitchen', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 21012857} 2025-03-31 01:17:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21012857&page=1> {'review': 'Really disappointed food', 'review_id': 291276816, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 48, 'brand_name': 'Sakura - A Far Eastern Kitchen', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 21012857} 2025-03-31 01:17:32 [reviews] INFO: Scraped item: {'review': 'The food was really delicious. we tried sushi, dimsum,Bao,main course,dessert. Everything was amazing', 'review_id': 290321961, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-27', 'competitor_id': 48, 'brand_name': 'Sakura - A Far Eastern Kitchen', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 21012857} 2025-03-31 01:17:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21012857&page=1> {'review': 'The food was really delicious. we tried sushi, dimsum,Bao,main course,dessert. Everything was amazing', 'review_id': 290321961, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-27', 'competitor_id': 48, 'brand_name': 'Sakura - A Far Eastern Kitchen', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 21012857} 2025-03-31 01:17:32 [reviews] INFO: Scraped item: {'review': 'it is very nice the waitress is sooo sweet my child loved her', 'review_id': 290289278, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-27', 'competitor_id': 48, 'brand_name': 'Sakura - A Far Eastern Kitchen', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 21012857} 2025-03-31 01:17:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21012857&page=1> {'review': 'it is very nice the waitress is sooo sweet my child loved her', 'review_id': 290289278, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-27', 'competitor_id': 48, 'brand_name': 'Sakura - A Far Eastern Kitchen', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 21012857} 2025-03-31 01:17:32 [reviews] INFO: Scraped item: {'review': 'need to improve the food more. music was absent.', 'review_id': 289930043, 'rating': '3', 'review_type': 'DINING', 'review_date': '2025-03-26', 'competitor_id': 48, 'brand_name': 'Sakura - A Far Eastern Kitchen', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 21012857} 2025-03-31 01:17:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21012857&page=1> {'review': 'need to improve the food more. music was absent.', 'review_id': 289930043, 'rating': '3', 'review_type': 'DINING', 'review_date': '2025-03-26', 'competitor_id': 48, 'brand_name': 'Sakura - A Far Eastern Kitchen', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 21012857} 2025-03-31 01:17:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:17:34 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 29, 'brand_name': 'abCoffee', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21031542, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383801, 'download_latency': 0.9325404167175293, 'depth': 0} 2025-03-31 01:17:34 [reviews] INFO: Stopping for res_id: 21031542 as reviews are older than 7 days. 2025-03-31 01:17:37 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:17:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:17:44 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:17:48 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:17:51 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:17:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:17:55 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 3', 'platform': 'zomato', 'res_id': 21061214, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383821, 'download_latency': 1.2376220226287842, 'depth': 0} 2025-03-31 01:17:55 [reviews] INFO: Scraped item: {'review': 'very oily', 'review_id': 291253852, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 3', 'platform': 'zomato', 'res_id': 21061214} 2025-03-31 01:17:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21061214&page=1> {'review': 'very oily', 'review_id': 291253852, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 3', 'platform': 'zomato', 'res_id': 21061214} 2025-03-31 01:17:55 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290976044, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 3', 'platform': 'zomato', 'res_id': 21061214} 2025-03-31 01:17:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21061214&page=1> {'review': '', 'review_id': 290976044, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 3', 'platform': 'zomato', 'res_id': 21061214} 2025-03-31 01:17:55 [reviews] INFO: Scraped item: {'review': 'Its is the worst biryani i had till date', 'review_id': 289685578, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 3', 'platform': 'zomato', 'res_id': 21061214} 2025-03-31 01:17:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21061214&page=1> {'review': 'Its is the worst biryani i had till date', 'review_id': 289685578, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 3', 'platform': 'zomato', 'res_id': 21061214} 2025-03-31 01:17:55 [reviews] INFO: Stopping for res_id: 21061214 as reviews are older than 7 days. 2025-03-31 01:17:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:17:59 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 29, 'brand_name': 'abCoffee', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 21091083, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383825, 'download_latency': 1.02911376953125, 'depth': 0} 2025-03-31 01:17:59 [reviews] INFO: Scraped item: {'review': 'The crossoint was soggy and not upto the mark ', 'review_id': 290406010, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 29, 'brand_name': 'abCoffee', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 21091083} 2025-03-31 01:17:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21091083&page=1> {'review': 'The crossoint was soggy and not upto the mark ', 'review_id': 290406010, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 29, 'brand_name': 'abCoffee', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 21091083} 2025-03-31 01:17:59 [reviews] INFO: Stopping for res_id: 21091083 as reviews are older than 7 days. 2025-03-31 01:18:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:18:06 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:18:09 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:18:13 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:18:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:18:19 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383839, 'download_latency': 1.239959955215454, 'depth': 0} 2025-03-31 01:18:19 [reviews] INFO: Scraped item: {'review': 'The meat was not cooked at all and the quality of the mutton was not great.The pieces were extremely chewy', 'review_id': 291547956, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421} 2025-03-31 01:18:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21131421&page=1> {'review': 'The meat was not cooked at all and the quality of the mutton was not great.The pieces were extremely chewy', 'review_id': 291547956, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421} 2025-03-31 01:18:19 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291506482, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421} 2025-03-31 01:18:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21131421&page=1> {'review': '', 'review_id': 291506482, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421} 2025-03-31 01:18:19 [reviews] INFO: Stopping for res_id: 21131421 as reviews are older than 7 days. 2025-03-31 01:18:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:18:22 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Khar', 'platform': 'zomato', 'res_id': 21144195, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383843, 'download_latency': 1.1180014610290527, 'depth': 0} 2025-03-31 01:18:22 [reviews] INFO: Stopping for res_id: 21144195 as reviews are older than 7 days. 2025-03-31 01:18:22 [scrapy.extensions.logstats] INFO: Crawled 213 pages (at 6 pages/min), scraped 670 items (at 11 items/min) 2025-03-31 01:18:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:18:25 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 21146712, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383847, 'download_latency': 1.358766794204712, 'depth': 0} 2025-03-31 01:18:25 [reviews] INFO: Scraped item: {'review': 'ess', 'review_id': 291407052, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 21146712} 2025-03-31 01:18:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21146712&page=1> {'review': 'ess', 'review_id': 291407052, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 21146712} 2025-03-31 01:18:25 [reviews] INFO: Scraped item: {'review': 'no gravy, no onion salad', 'review_id': 290098208, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 21146712} 2025-03-31 01:18:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21146712&page=1> {'review': 'no gravy, no onion salad', 'review_id': 290098208, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 21146712} 2025-03-31 01:18:25 [reviews] INFO: Scraped item: {'review': 'worst response from help center ', 'review_id': 289683361, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 21146712} 2025-03-31 01:18:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21146712&page=1> {'review': 'worst response from help center ', 'review_id': 289683361, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-25', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 21146712} 2025-03-31 01:18:25 [reviews] INFO: Stopping for res_id: 21146712 as reviews are older than 7 days. 2025-03-31 01:18:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:18:28 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 84, 'brand_name': 'Tea Post', 'city': 'Mumbai', 'sub_zone': 'Dadar West', 'platform': 'zomato', 'res_id': 21189690, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383853, 'download_latency': 1.207226276397705, 'depth': 0} 2025-03-31 01:18:28 [reviews] INFO: Scraped item: {'review': 'tea should have been hotter', 'review_id': 290497087, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 84, 'brand_name': 'Tea Post', 'city': 'Mumbai', 'sub_zone': 'Dadar West', 'platform': 'zomato', 'res_id': 21189690} 2025-03-31 01:18:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21189690&page=1> {'review': 'tea should have been hotter', 'review_id': 290497087, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 84, 'brand_name': 'Tea Post', 'city': 'Mumbai', 'sub_zone': 'Dadar West', 'platform': 'zomato', 'res_id': 21189690} 2025-03-31 01:18:28 [reviews] INFO: Stopping for res_id: 21189690 as reviews are older than 7 days. 2025-03-31 01:18:31 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:18:35 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:18:39 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:18:44 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:18:48 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:18:52 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:18:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:18:56 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 96, 'brand_name': "Dunkin' - Donuts & Coffee", 'city': 'Bangalore', 'sub_zone': 'Bellandur', 'platform': 'zomato', 'res_id': 21195455, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383876, 'download_latency': 1.3758208751678467, 'depth': 0} 2025-03-31 01:18:56 [reviews] INFO: Stopping for res_id: 21195455 as reviews are older than 7 days. 2025-03-31 01:18:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:19:00 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Ghatkopar', 'platform': 'zomato', 'res_id': 21219960, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383880, 'download_latency': 1.1876797676086426, 'depth': 0} 2025-03-31 01:19:00 [reviews] INFO: Scraped item: {'review': 'Received the pizza as cold and looks like it was made very much before I ordered my pizza', 'review_id': 291639673, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Ghatkopar', 'platform': 'zomato', 'res_id': 21219960} 2025-03-31 01:19:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21219960&page=1> {'review': 'Received the pizza as cold and looks like it was made very much before I ordered my pizza', 'review_id': 291639673, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Ghatkopar', 'platform': 'zomato', 'res_id': 21219960} 2025-03-31 01:19:00 [reviews] INFO: Scraped item: {'review': 'The feta was spoilt. Please reimburse.', 'review_id': 291573107, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Ghatkopar', 'platform': 'zomato', 'res_id': 21219960} 2025-03-31 01:19:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21219960&page=1> {'review': 'The feta was spoilt. Please reimburse.', 'review_id': 291573107, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Ghatkopar', 'platform': 'zomato', 'res_id': 21219960} 2025-03-31 01:19:00 [reviews] INFO: Scraped item: {'review': 'Burnt pizza', 'review_id': 290357449, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Ghatkopar', 'platform': 'zomato', 'res_id': 21219960} 2025-03-31 01:19:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21219960&page=1> {'review': 'Burnt pizza', 'review_id': 290357449, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Ghatkopar', 'platform': 'zomato', 'res_id': 21219960} 2025-03-31 01:19:00 [reviews] INFO: Stopping for res_id: 21219960 as reviews are older than 7 days. 2025-03-31 01:19:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:19:06 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:19:11 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:19:15 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:19:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:19:21 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383899, 'download_latency': 2.587080955505371, 'depth': 0} 2025-03-31 01:19:21 [reviews] INFO: Scraped item: {'review': 'testy food ', 'review_id': 291750149, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450} 2025-03-31 01:19:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21227450&page=1> {'review': 'testy food ', 'review_id': 291750149, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450} 2025-03-31 01:19:21 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291404840, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450} 2025-03-31 01:19:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21227450&page=1> {'review': '', 'review_id': 291404840, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450} 2025-03-31 01:19:21 [reviews] INFO: Scraped item: {'review': 'super test ', 'review_id': 291342134, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450} 2025-03-31 01:19:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21227450&page=1> {'review': 'super test ', 'review_id': 291342134, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450} 2025-03-31 01:19:21 [reviews] INFO: Scraped item: {'review': 'Awesome ', 'review_id': 290975988, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450} 2025-03-31 01:19:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21227450&page=1> {'review': 'Awesome ', 'review_id': 290975988, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450} 2025-03-31 01:19:21 [reviews] INFO: Scraped item: {'review': 'testy food', 'review_id': 290955189, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450} 2025-03-31 01:19:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21227450&page=1> {'review': 'testy food', 'review_id': 290955189, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450} 2025-03-31 01:19:22 [scrapy.extensions.logstats] INFO: Crawled 218 pages (at 5 pages/min), scraped 682 items (at 12 items/min) 2025-03-31 01:19:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:19:23 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 96, 'brand_name': "Dunkin' - Donuts & Coffee", 'city': 'Bangalore', 'sub_zone': 'Cunningham Road', 'platform': 'zomato', 'res_id': 21236774, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383902, 'download_latency': 1.3356781005859375, 'depth': 0} 2025-03-31 01:19:23 [reviews] INFO: Stopping for res_id: 21236774 as reviews are older than 7 days. 2025-03-31 01:19:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:19:26 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 21240266, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383905, 'download_latency': 1.3031885623931885, 'depth': 0} 2025-03-31 01:19:26 [reviews] INFO: Scraped item: {'review': 'Great packaging ', 'review_id': 290253565, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 21240266} 2025-03-31 01:19:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21240266&page=1> {'review': 'Great packaging ', 'review_id': 290253565, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 21240266} 2025-03-31 01:19:26 [reviews] INFO: Stopping for res_id: 21240266 as reviews are older than 7 days. 2025-03-31 01:19:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:19:30 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383908, 'download_latency': 1.306915044784546, 'depth': 0} 2025-03-31 01:19:30 [reviews] INFO: Scraped item: {'review': 'It was wrong product', 'review_id': 291504420, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546} 2025-03-31 01:19:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21264546&page=1> {'review': 'It was wrong product', 'review_id': 291504420, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546} 2025-03-31 01:19:30 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291156780, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546} 2025-03-31 01:19:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21264546&page=1> {'review': '', 'review_id': 291156780, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546} 2025-03-31 01:19:30 [reviews] INFO: Scraped item: {'review': 'lovely packaging .food is so fresh and tasty ', 'review_id': 291077276, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546} 2025-03-31 01:19:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21264546&page=1> {'review': 'lovely packaging .food is so fresh and tasty ', 'review_id': 291077276, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546} 2025-03-31 01:19:30 [reviews] INFO: Scraped item: {'review': 'Completely pouring out oil. Do not expect such pathetic quality from such high name. Both kachori and samosa were double fried and it felt like we are only drinking oil. Will never order from here', 'review_id': 290210847, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546} 2025-03-31 01:19:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21264546&page=1> {'review': 'Completely pouring out oil. Do not expect such pathetic quality from such high name. Both kachori and samosa were double fried and it felt like we are only drinking oil. Will never order from here', 'review_id': 290210847, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546} 2025-03-31 01:19:30 [reviews] INFO: Scraped item: {'review': 'Seriously not expected taste... taste less rasmalai and blend Kachori taste', 'review_id': 290154886, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546} 2025-03-31 01:19:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21264546&page=1> {'review': 'Seriously not expected taste... taste less rasmalai and blend Kachori taste', 'review_id': 290154886, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546} 2025-03-31 01:19:34 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:19:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:19:39 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:19:41 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:19:45 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:19:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:19:51 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383932, 'download_latency': 2.011427640914917, 'depth': 0} 2025-03-31 01:19:51 [reviews] INFO: Scraped item: {'review': 'JALEBIS WERE COLD&STALE.REMOVE ON YOUR MENU HIT JALEBIS PUT COLD JALEBIS.DISGHUSING', 'review_id': 291641155, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729} 2025-03-31 01:19:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21275729&page=1> {'review': 'JALEBIS WERE COLD&STALE.REMOVE ON YOUR MENU HIT JALEBIS PUT COLD JALEBIS.DISGHUSING', 'review_id': 291641155, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729} 2025-03-31 01:19:51 [reviews] INFO: Scraped item: {'review': 'I recently ordered kesar ghewar, rasmalai , Assorted meethai box from Meetha by Radisson, and I must say, it was an absolute delight! The quality was top-notch, and the flavors were rich and authentic. also packaging was neat, hygienic and presentable.

Highly recommended for anyone craving premium mithai! Will definitely be ordering again.

', 'review_id': 291260844, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729} 2025-03-31 01:19:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21275729&page=1> {'review': 'I recently ordered kesar ghewar, rasmalai , Assorted meethai box from Meetha by Radisson, and I must say, it was an absolute delight! The quality was top-notch, and the flavors were rich and authentic. also packaging was neat, hygienic and presentable.

Highly recommended for anyone craving premium mithai! Will definitely be ordering again.

', 'review_id': 291260844, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729} 2025-03-31 01:19:51 [reviews] INFO: Scraped item: {'review': "Kachori was horrible, I felt like I was eating a dough there was no flakiness taste was very bad couldn't even eat a bite.", 'review_id': 290953320, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729} 2025-03-31 01:19:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21275729&page=1> {'review': "Kachori was horrible, I felt like I was eating a dough there was no flakiness taste was very bad couldn't even eat a bite.", 'review_id': 290953320, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-29', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729} 2025-03-31 01:19:51 [reviews] INFO: Scraped item: {'review': 'Please cut the minimum quantity of 12 to 6 sweets . It will be help for a small family mostly seniors .', 'review_id': 290838727, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-28', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729} 2025-03-31 01:19:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21275729&page=1> {'review': 'Please cut the minimum quantity of 12 to 6 sweets . It will be help for a small family mostly seniors .', 'review_id': 290838727, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-28', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729} 2025-03-31 01:19:51 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290745126, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729} 2025-03-31 01:19:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21275729&page=1> {'review': '', 'review_id': 290745126, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729} 2025-03-31 01:19:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:19:53 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Navi Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21330620, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383936, 'download_latency': 1.3242740631103516, 'depth': 0} 2025-03-31 01:19:53 [reviews] INFO: Scraped item: {'review': 'good food ', 'review_id': 290455613, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-27', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Navi Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21330620} 2025-03-31 01:19:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21330620&page=1> {'review': 'good food ', 'review_id': 290455613, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-27', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Navi Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21330620} 2025-03-31 01:19:53 [reviews] INFO: Scraped item: {'review': 'I like this but this time quantity was less...only 5 pieces in a box...i have bought it earlier and then it was not the case... kindly look into it.', 'review_id': 289977061, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Navi Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21330620} 2025-03-31 01:19:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21330620&page=1> {'review': 'I like this but this time quantity was less...only 5 pieces in a box...i have bought it earlier and then it was not the case... kindly look into it.', 'review_id': 289977061, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Navi Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21330620} 2025-03-31 01:19:53 [reviews] INFO: Stopping for res_id: 21330620 as reviews are older than 7 days. 2025-03-31 01:19:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:19:56 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 74, 'brand_name': "Good Flippin' Burgers", 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 21363127, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383940, 'download_latency': 1.1809413433074951, 'depth': 0} 2025-03-31 01:19:56 [reviews] INFO: Scraped item: {'review': 'meat burger was not cooked (raw in places)', 'review_id': 291175415, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 74, 'brand_name': "Good Flippin' Burgers", 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 21363127} 2025-03-31 01:19:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21363127&page=1> {'review': 'meat burger was not cooked (raw in places)', 'review_id': 291175415, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 74, 'brand_name': "Good Flippin' Burgers", 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 21363127} 2025-03-31 01:19:56 [reviews] INFO: Scraped item: {'review': 'your burger had undercooked beef patty . ', 'review_id': 290270820, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 74, 'brand_name': "Good Flippin' Burgers", 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 21363127} 2025-03-31 01:19:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21363127&page=1> {'review': 'your burger had undercooked beef patty . ', 'review_id': 290270820, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-27', 'competitor_id': 74, 'brand_name': "Good Flippin' Burgers", 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 21363127} 2025-03-31 01:19:56 [reviews] INFO: Stopping for res_id: 21363127 as reviews are older than 7 days. 2025-03-31 01:20:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:20:03 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:20:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:20:11 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:20:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:20:15 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21393822, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383962, 'download_latency': 1.4733483791351318, 'depth': 0} 2025-03-31 01:20:15 [reviews] INFO: Scraped item: {'review': 'Coffee this time was not up to the mark. There was something missing.', 'review_id': 291371623, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21393822} 2025-03-31 01:20:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21393822&page=1> {'review': 'Coffee this time was not up to the mark. There was something missing.', 'review_id': 291371623, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21393822} 2025-03-31 01:20:15 [reviews] INFO: Scraped item: {'review': 'Amazingggg!!!', 'review_id': 290667921, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21393822} 2025-03-31 01:20:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21393822&page=1> {'review': 'Amazingggg!!!', 'review_id': 290667921, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21393822} 2025-03-31 01:20:15 [reviews] INFO: Scraped item: {'review': 'Just perfect!!', 'review_id': 290036161, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21393822} 2025-03-31 01:20:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21393822&page=1> {'review': 'Just perfect!!', 'review_id': 290036161, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-26', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21393822} 2025-03-31 01:20:15 [reviews] INFO: Stopping for res_id: 21393822 as reviews are older than 7 days. 2025-03-31 01:20:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:20:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:20:22 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21395028, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383967, 'download_latency': 1.0738437175750732, 'depth': 0} 2025-03-31 01:20:22 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291459899, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21395028} 2025-03-31 01:20:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21395028&page=1> {'review': '', 'review_id': 291459899, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21395028} 2025-03-31 01:20:22 [reviews] INFO: Scraped item: {'review': 'The 3 cheese Kulcha is to die for.
Yash was our host.', 'review_id': 291206721, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21395028} 2025-03-31 01:20:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21395028&page=1> {'review': 'The 3 cheese Kulcha is to die for.
Yash was our host.', 'review_id': 291206721, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21395028} 2025-03-31 01:20:22 [reviews] INFO: Stopping for res_id: 21395028 as reviews are older than 7 days. 2025-03-31 01:20:22 [scrapy.extensions.logstats] INFO: Crawled 226 pages (at 8 pages/min), scraped 702 items (at 20 items/min) 2025-03-31 01:20:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:20:26 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '4 Bungalows', 'platform': 'zomato', 'res_id': 21401321, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383971, 'download_latency': 1.3820784091949463, 'depth': 0} 2025-03-31 01:20:26 [reviews] INFO: Scraped item: {'review': 'quantity is way less then aspected', 'review_id': 291772650, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '4 Bungalows', 'platform': 'zomato', 'res_id': 21401321} 2025-03-31 01:20:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21401321&page=1> {'review': 'quantity is way less then aspected', 'review_id': 291772650, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '4 Bungalows', 'platform': 'zomato', 'res_id': 21401321} 2025-03-31 01:20:26 [reviews] INFO: Scraped item: {'review': 'prawns are not cooked properly ', 'review_id': 291764108, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '4 Bungalows', 'platform': 'zomato', 'res_id': 21401321} 2025-03-31 01:20:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21401321&page=1> {'review': 'prawns are not cooked properly ', 'review_id': 291764108, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '4 Bungalows', 'platform': 'zomato', 'res_id': 21401321} 2025-03-31 01:20:26 [reviews] INFO: Scraped item: {'review': 'too Salty', 'review_id': 291762308, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '4 Bungalows', 'platform': 'zomato', 'res_id': 21401321} 2025-03-31 01:20:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21401321&page=1> {'review': 'too Salty', 'review_id': 291762308, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '4 Bungalows', 'platform': 'zomato', 'res_id': 21401321} 2025-03-31 01:20:26 [reviews] INFO: Scraped item: {'review': 'packaging and food both are best. But the tap wrapped on food box is problematic to open', 'review_id': 291748173, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '4 Bungalows', 'platform': 'zomato', 'res_id': 21401321} 2025-03-31 01:20:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21401321&page=1> {'review': 'packaging and food both are best. But the tap wrapped on food box is problematic to open', 'review_id': 291748173, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '4 Bungalows', 'platform': 'zomato', 'res_id': 21401321} 2025-03-31 01:20:26 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291700320, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '4 Bungalows', 'platform': 'zomato', 'res_id': 21401321} 2025-03-31 01:20:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21401321&page=1> {'review': '', 'review_id': 291700320, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '4 Bungalows', 'platform': 'zomato', 'res_id': 21401321} 2025-03-31 01:20:28 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:20:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:20:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:20:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:20:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:20:45 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 25, 'brand_name': "Veronica's", 'city': 'Mumbai', 'sub_zone': 'Bandra East', 'platform': 'zomato', 'res_id': 21432852, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383986, 'download_latency': 0.9677340984344482, 'depth': 0} 2025-03-31 01:20:45 [reviews] INFO: Stopping for res_id: 21432852 as reviews are older than 7 days. 2025-03-31 01:20:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:20:49 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 37, 'brand_name': 'Blue Tokai Coffee Roasters', 'city': 'Bangalore', 'sub_zone': 'Lavelle Road', 'platform': 'zomato', 'res_id': 21462394, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383991, 'download_latency': 1.4064476490020752, 'depth': 0} 2025-03-31 01:20:49 [reviews] INFO: Stopping for res_id: 21462394 as reviews are older than 7 days. 2025-03-31 01:20:51 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:20:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:20:56 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743383997, 'download_latency': 0.8525760173797607, 'depth': 0} 2025-03-31 01:20:56 [reviews] INFO: Scraped item: {'review': '', 'review_id': 290823740, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794} 2025-03-31 01:20:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21503794&page=1> {'review': '', 'review_id': 290823740, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794} 2025-03-31 01:20:56 [reviews] INFO: Scraped item: {'review': 'I was expecting 4 pieces but got only 2', 'review_id': 290818192, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794} 2025-03-31 01:20:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21503794&page=1> {'review': 'I was expecting 4 pieces but got only 2', 'review_id': 290818192, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794} 2025-03-31 01:20:56 [reviews] INFO: Scraped item: {'review': 'Delayed for 21 mins. Awful experience.', 'review_id': 290816310, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794} 2025-03-31 01:20:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21503794&page=1> {'review': 'Delayed for 21 mins. Awful experience.', 'review_id': 290816310, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794} 2025-03-31 01:20:56 [reviews] INFO: Scraped item: {'review': 'Biryani was good but lamb pieces should be more cooked. It was hard to remove flesh from bones', 'review_id': 290678322, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794} 2025-03-31 01:20:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21503794&page=1> {'review': 'Biryani was good but lamb pieces should be more cooked. It was hard to remove flesh from bones', 'review_id': 290678322, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794} 2025-03-31 01:20:56 [reviews] INFO: Scraped item: {'review': 'it is half in handi. ', 'review_id': 290615335, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794} 2025-03-31 01:20:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21503794&page=1> {'review': 'it is half in handi. ', 'review_id': 290615335, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794} 2025-03-31 01:20:59 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:21:03 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:21:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:21:09 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:21:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:21:14 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 29, 'brand_name': 'abCoffee', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21514302, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743384016, 'download_latency': 0.7487764358520508, 'depth': 0} 2025-03-31 01:21:14 [reviews] INFO: Stopping for res_id: 21514302 as reviews are older than 7 days. 2025-03-31 01:21:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:21:22 [scrapy.extensions.logstats] INFO: Crawled 231 pages (at 5 pages/min), scraped 712 items (at 10 items/min) 2025-03-31 01:21:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:21:24 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743384022, 'download_latency': 3.1237409114837646, 'depth': 0} 2025-03-31 01:21:24 [reviews] INFO: Scraped item: {'review': 'very bad experience . flies everywhere, burger tasted horrible,fries were reheated and served ,that too uncooked from inside . coffee(cappucino) was frothy and tasteless,never going back.', 'review_id': 291637722, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554} 2025-03-31 01:21:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21528554&page=1> {'review': 'very bad experience . flies everywhere, burger tasted horrible,fries were reheated and served ,that too uncooked from inside . coffee(cappucino) was frothy and tasteless,never going back.', 'review_id': 291637722, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554} 2025-03-31 01:21:24 [reviews] INFO: Scraped item: {'review': 'Rajal was amazing at the service. Great place to dine!', 'review_id': 291591199, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554} 2025-03-31 01:21:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21528554&page=1> {'review': 'Rajal was amazing at the service. Great place to dine!', 'review_id': 291591199, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554} 2025-03-31 01:21:24 [reviews] INFO: Scraped item: {'review': 'Burger is messy and they did not give the fries along with burger, which they are suppose to give', 'review_id': 291273218, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554} 2025-03-31 01:21:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21528554&page=1> {'review': 'Burger is messy and they did not give the fries along with burger, which they are suppose to give', 'review_id': 291273218, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554} 2025-03-31 01:21:24 [reviews] INFO: Scraped item: {'review': 'The place was unfortunately swarming with flies, which really took away from the overall experience. I ended up packing my food to go, just so I could enjoy it in peace at home without constantly having to deal with the nuisance. In contrast, my recent visit to PAUL in Pune was a completely different experience it was clean, well-maintained, and pleasant. If this level of hygiene and ambience continues here, it may be difficult for the place to sustain in the long run.', 'review_id': 291209165, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554} 2025-03-31 01:21:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21528554&page=1> {'review': 'The place was unfortunately swarming with flies, which really took away from the overall experience. I ended up packing my food to go, just so I could enjoy it in peace at home without constantly having to deal with the nuisance. In contrast, my recent visit to PAUL in Pune was a completely different experience it was clean, well-maintained, and pleasant. If this level of hygiene and ambience continues here, it may be difficult for the place to sustain in the long run.', 'review_id': 291209165, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-30', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554} 2025-03-31 01:21:24 [reviews] INFO: Scraped item: {'review': '', 'review_id': 291208105, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554} 2025-03-31 01:21:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21528554&page=1> {'review': '', 'review_id': 291208105, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554} 2025-03-31 01:21:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:21:25 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 33, 'brand_name': 'Nandan Coffee', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21565814, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743384026, 'download_latency': 0.622556209564209, 'depth': 0} 2025-03-31 01:21:25 [reviews] INFO: Stopping for res_id: 21565814 as reviews are older than 7 days. 2025-03-31 01:21:28 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:21:31 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:21:35 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:21:39 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:21:43 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:21:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:21:46 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 21568377, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743384049, 'download_latency': 0.6936566829681396, 'depth': 0} 2025-03-31 01:21:46 [reviews] INFO: Scraped item: {'review': 'Found hair in food', 'review_id': 291367423, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 21568377} 2025-03-31 01:21:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21568377&page=1> {'review': 'Found hair in food', 'review_id': 291367423, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 21568377} 2025-03-31 01:21:46 [reviews] INFO: Scraped item: {'review': 'Such a delay in delivery not accepted', 'review_id': 291137902, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 21568377} 2025-03-31 01:21:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21568377&page=1> {'review': 'Such a delay in delivery not accepted', 'review_id': 291137902, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 21568377} 2025-03-31 01:21:46 [reviews] INFO: Scraped item: {'review': 'good food', 'review_id': 291091026, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 21568377} 2025-03-31 01:21:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21568377&page=1> {'review': 'good food', 'review_id': 291091026, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-30', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 21568377} 2025-03-31 01:21:46 [reviews] INFO: Scraped item: {'review': 'Undoubtedly the worst biriyani I have ever had.', 'review_id': 290713881, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 21568377} 2025-03-31 01:21:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21568377&page=1> {'review': 'Undoubtedly the worst biriyani I have ever had.', 'review_id': 290713881, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 21568377} 2025-03-31 01:21:46 [reviews] INFO: Scraped item: {'review': 'Order is very late food is smelling like expired', 'review_id': 290676702, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 21568377} 2025-03-31 01:21:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21568377&page=1> {'review': 'Order is very late food is smelling like expired', 'review_id': 290676702, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 21568377} 2025-03-31 01:21:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:21:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-31 01:21:53 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 27, 'brand_name': 'Grey Soul Coffee Roasters', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 21575164, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1743384056, 'download_latency': 0.7579872608184814, 'depth': 0} 2025-03-31 01:21:53 [reviews] INFO: Scraped item: {'review': 'Loved my visit here, Perfect way to start my mornings. Vibe is so calming and the match made it even better.', 'review_id': 289843168, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-25', 'competitor_id': 27, 'brand_name': 'Grey Soul Coffee Roasters', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 21575164} 2025-03-31 01:21:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21575164&page=1> {'review': 'Loved my visit here, Perfect way to start my mornings. Vibe is so calming and the match made it even better.', 'review_id': 289843168, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-25', 'competitor_id': 27, 'brand_name': 'Grey Soul Coffee Roasters', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 21575164} 2025-03-31 01:21:53 [reviews] INFO: Stopping for res_id: 21575164 as reviews are older than 7 days. 2025-03-31 01:21:56 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:21:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:22:01 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:22:04 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:22:08 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:22:12 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:22:15 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:22:17 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:22:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:22:22 [scrapy.extensions.logstats] INFO: Crawled 235 pages (at 4 pages/min), scraped 723 items (at 11 items/min) 2025-03-31 01:22:23 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:22:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-31 01:22:24 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-31 01:22:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:22:31 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:22:33 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:22:36 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:22:38 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:22:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:22:47 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:22:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:22:53 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:22:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:22:59 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:23:04 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:23:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:23:09 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:23:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:23:17 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:23:21 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:23:22 [scrapy.extensions.logstats] INFO: Crawled 235 pages (at 0 pages/min), scraped 723 items (at 0 items/min) 2025-03-31 01:23:25 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:23:29 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:23:32 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:23:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:23:39 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:23:43 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:23:45 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:23:50 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:23:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:23:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:24:00 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:24:04 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:24:08 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:24:12 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:24:16 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-31 01:24:16 [scrapy.core.engine] INFO: Closing spider (finished) 2025-03-31 01:24:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): cron.restaverse.com:443 2025-03-31 01:24:16 [urllib3.connectionpool] DEBUG: https://cron.restaverse.com:443 "POST /insert_data/ HTTP/11" 201 112 2025-03-31 01:24:16 [reviews] INFO: Data posted successfully. 2025-03-31 01:24:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-31 01:24:17 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-31 01:24:17 [scrapy.statscollectors] INFO: Dumping Scrapy stats: {'downloader/exception_count': 612, 'downloader/exception_type_count/scrapy.core.downloader.handlers.http11.TunnelError': 611, 'downloader/exception_type_count/twisted.web._newclient.ResponseNeverReceived': 1, 'downloader/request_bytes': 767097, 'downloader/request_count': 847, 'downloader/request_method_count/GET': 847, 'downloader/response_bytes': 1187484, 'downloader/response_count': 235, 'downloader/response_status_count/200': 234, 'downloader/response_status_count/400': 1, 'elapsed_time_seconds': 3113.91658, 'finish_reason': 'finished', 'finish_time': datetime.datetime(2025, 3, 31, 1, 24, 16, 524562, tzinfo=datetime.timezone.utc), 'httpcompression/response_bytes': 2181959, 'httpcompression/response_count': 234, 'item_scraped_count': 723, 'items_per_minute': None, 'log_count/DEBUG': 1545, 'log_count/ERROR': 107, 'log_count/INFO': 1151, 'memusage/max': 78454784, 'memusage/startup': 64823296, 'request_depth_max': 1, 'response_received_count': 235, 'responses_per_minute': None, 'retry/count': 510, 'retry/max_reached': 102, 'retry/reason_count/scrapy.core.downloader.handlers.http11.TunnelError': 509, 'retry/reason_count/twisted.web._newclient.ResponseNeverReceived': 1, 'scheduler/dequeued': 847, 'scheduler/dequeued/memory': 847, 'scheduler/enqueued': 847, 'scheduler/enqueued/memory': 847, 'start_time': datetime.datetime(2025, 3, 31, 0, 32, 22, 607982, tzinfo=datetime.timezone.utc)} 2025-03-31 01:24:17 [scrapy.core.engine] INFO: Spider closed (finished)