2025-03-12 08:58:56 [scrapy.utils.log] INFO: Scrapy 2.12.0 started (bot: zomato_competiton_analysis) 2025-03-12 08:58:56 [scrapy.utils.log] INFO: Versions: lxml 5.3.0.0, libxml2 2.12.9, cssselect 1.2.0, parsel 1.9.1, w3lib 2.2.1, Twisted 24.11.0, Python 3.10.12 (main, Feb 4 2025, 14:57:36) [GCC 11.4.0], pyOpenSSL 24.3.0 (OpenSSL 3.4.0 22 Oct 2024), cryptography 44.0.0, Platform Linux-6.8.0-1015-aws-aarch64-with-glibc2.35 2025-03-12 08:58:56 [scrapy.addons] INFO: Enabled addons: [] 2025-03-12 08:58:56 [asyncio] DEBUG: Using selector: EpollSelector 2025-03-12 08:58:56 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor 2025-03-12 08:58:56 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop 2025-03-12 08:58:56 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor 2025-03-12 08:58:56 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop 2025-03-12 08:58:56 [scrapy.extensions.telnet] INFO: Telnet Password: b162502e2cf9a8a8 2025-03-12 08:58:56 [scrapy.middleware] INFO: Enabled extensions: ['scrapy.extensions.corestats.CoreStats', 'scrapy.extensions.telnet.TelnetConsole', 'scrapy.extensions.memusage.MemoryUsage', 'scrapy.extensions.logstats.LogStats', 'scrapeops_scrapy.extension.ScrapeOpsMonitor'] 2025-03-12 08:58:56 [scrapy.crawler] INFO: Overridden settings: {'BOT_NAME': 'zomato_competiton_analysis', 'DOWNLOAD_DELAY': 3, 'DOWNLOAD_TIMEOUT': 30, 'FEED_EXPORT_ENCODING': 'utf-8', 'LOG_FILE': '/home/ubuntu/restaverse_spiders/logs/zomato_competiton_analysis/reviews/zomato ' 'competitor analysis reviws_2025-03-12T08_58_55.log', 'NEWSPIDER_MODULE': 'zomato_competiton_analysis.spiders', 'RETRY_HTTP_CODES': [500, 502, 503, 504, 408], 'RETRY_TIMES': 5, 'SPIDER_MODULES': ['zomato_competiton_analysis.spiders'], 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor'} 2025-03-12 08:58:56 [scrapy.middleware] INFO: Enabled downloader middlewares: ['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware', 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware', 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware', 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware', 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware', 'scrapeops_scrapy.middleware.retry.RetryMiddleware', 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware', 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware', 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware', 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware', 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware', 'scrapy.downloadermiddlewares.stats.DownloaderStats'] 2025-03-12 08:58:56 [scrapy.middleware] INFO: Enabled spider middlewares: ['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware', 'scrapy.spidermiddlewares.referer.RefererMiddleware', 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware', 'scrapy.spidermiddlewares.depth.DepthMiddleware'] 2025-03-12 08:58:56 [scrapy.middleware] INFO: Enabled item pipelines: ['zomato_competiton_analysis.pipelines.ZomatoCompetionAnalysisPipeline'] 2025-03-12 08:58:56 [scrapy.core.engine] INFO: Spider opened 2025-03-12 08:58:56 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-03-12 08:58:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-12 08:58:57 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/setup/ HTTP/11" 200 None 2025-03-12 08:58:57 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023 2025-03-12 08:58:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): cron.restaverse.com:443 2025-03-12 08:58:57 [urllib3.connectionpool] DEBUG: https://cron.restaverse.com:443 "POST /api/db_services/fetch-query HTTP/11" 200 29844 2025-03-12 08:58:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-12 08:58:58 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/normalizer/proxy_port/?job_id=3513568 HTTP/11" 200 None 2025-03-12 08:58:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-12 08:58:58 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/normalizer/domain/?domain=zomato.com HTTP/11" 200 241 2025-03-12 08:59:01 [scrapy.core.engine] DEBUG: Crawled (400) (referer: None) 2025-03-12 08:59:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 08:59:03 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741769939, 'download_latency': 1.166917324066162, 'depth': 0} 2025-03-12 08:59:03 [reviews] INFO: Scraped item: {'review': '', 'review_id': 285197472, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947} 2025-03-12 08:59:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=947&page=1> {'review': '', 'review_id': 285197472, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947} 2025-03-12 08:59:03 [reviews] INFO: Scraped item: {'review': 'Ordered Rainbow sushi which was damn tasty', 'review_id': 285129958, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947} 2025-03-12 08:59:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=947&page=1> {'review': 'Ordered Rainbow sushi which was damn tasty', 'review_id': 285129958, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947} 2025-03-12 08:59:03 [reviews] INFO: Scraped item: {'review': "Pan fried noodles in schezewan sauce was good as usual, Chicken dim sum's could have been more juicy, was a bit dry! Always love the food at Mamagato!", 'review_id': 284585001, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947} 2025-03-12 08:59:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=947&page=1> {'review': "Pan fried noodles in schezewan sauce was good as usual, Chicken dim sum's could have been more juicy, was a bit dry! Always love the food at Mamagato!", 'review_id': 284585001, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947} 2025-03-12 08:59:03 [reviews] INFO: Scraped item: {'review': 'Parag Lama Helped us with services', 'review_id': 284497129, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947} 2025-03-12 08:59:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=947&page=1> {'review': 'Parag Lama Helped us with services', 'review_id': 284497129, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947} 2025-03-12 08:59:03 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283731271, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947} 2025-03-12 08:59:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=947&page=1> {'review': '', 'review_id': 283731271, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947} 2025-03-12 08:59:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 08:59:07 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741769939, 'download_latency': 1.2367846965789795, 'depth': 0} 2025-03-12 08:59:07 [reviews] INFO: Scraped item: {'review': 'portion sizes were very small ', 'review_id': 285013277, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835} 2025-03-12 08:59:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32835&page=1> {'review': 'portion sizes were very small ', 'review_id': 285013277, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835} 2025-03-12 08:59:07 [reviews] INFO: Scraped item: {'review': 'Ordered during Ramadan, and the service was excellent! The dishes were flavourful and satisfying, and the delivery met expectations perfectly.', 'review_id': 284927292, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835} 2025-03-12 08:59:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32835&page=1> {'review': 'Ordered during Ramadan, and the service was excellent! The dishes were flavourful and satisfying, and the delivery met expectations perfectly.', 'review_id': 284927292, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835} 2025-03-12 08:59:07 [reviews] INFO: Scraped item: {'review': 'Tried the Ramadan delivery specials, and it was a delightful experience! The dishes were delicious with authentic spices, and the delivery was both quick and reliable', 'review_id': 284926330, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835} 2025-03-12 08:59:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32835&page=1> {'review': 'Tried the Ramadan delivery specials, and it was a delightful experience! The dishes were delicious with authentic spices, and the delivery was both quick and reliable', 'review_id': 284926330, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835} 2025-03-12 08:59:07 [reviews] INFO: Scraped item: {'review': 'food not good ', 'review_id': 284919504, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835} 2025-03-12 08:59:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32835&page=1> {'review': 'food not good ', 'review_id': 284919504, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835} 2025-03-12 08:59:07 [reviews] INFO: Scraped item: {'review': 'Forget the rest try the BEST great servings fast and delicious thank you all the way from NZ ', 'review_id': 284859919, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835} 2025-03-12 08:59:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32835&page=1> {'review': 'Forget the rest try the BEST great servings fast and delicious thank you all the way from NZ ', 'review_id': 284859919, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835} 2025-03-12 08:59:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 08:59:09 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 32971, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741769939, 'download_latency': 1.134183645248413, 'depth': 0} 2025-03-12 08:59:09 [reviews] INFO: Scraped item: {'review': 'Mr. Dileep who attended to our table was very good , professional and attentive. He made sure that we had s good experience', 'review_id': 284922763, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 32971} 2025-03-12 08:59:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32971&page=1> {'review': 'Mr. Dileep who attended to our table was very good , professional and attentive. He made sure that we had s good experience', 'review_id': 284922763, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 32971} 2025-03-12 08:59:09 [reviews] INFO: Scraped item: {'review': 'Both rotis were horrible and inedible', 'review_id': 284552033, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 32971} 2025-03-12 08:59:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32971&page=1> {'review': 'Both rotis were horrible and inedible', 'review_id': 284552033, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 32971} 2025-03-12 08:59:09 [reviews] INFO: Scraped item: {'review': 'there is no nalli in rogan ', 'review_id': 284465006, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 32971} 2025-03-12 08:59:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32971&page=1> {'review': 'there is no nalli in rogan ', 'review_id': 284465006, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 32971} 2025-03-12 08:59:09 [reviews] INFO: Scraped item: {'review': 'Food quality is good, Service by Ishtiyak is very good with polite attitude', 'review_id': 284316436, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 32971} 2025-03-12 08:59:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32971&page=1> {'review': 'Food quality is good, Service by Ishtiyak is very good with polite attitude', 'review_id': 284316436, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 32971} 2025-03-12 08:59:09 [reviews] INFO: Scraped item: {'review': 'dilip was excellent ', 'review_id': 283921982, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 32971} 2025-03-12 08:59:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32971&page=1> {'review': 'dilip was excellent ', 'review_id': 283921982, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 32971} 2025-03-12 08:59:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-12 08:59:12 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-12 08:59:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 08:59:14 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741769939, 'download_latency': 2.0016496181488037, 'depth': 0} 2025-03-12 08:59:14 [reviews] INFO: Scraped item: {'review': '', 'review_id': 285239697, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-12', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052} 2025-03-12 08:59:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34052&page=1> {'review': '', 'review_id': 285239697, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-12', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052} 2025-03-12 08:59:14 [reviews] INFO: Scraped item: {'review': 'Cold coffee has smell of muskmelon', 'review_id': 285192315, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052} 2025-03-12 08:59:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34052&page=1> {'review': 'Cold coffee has smell of muskmelon', 'review_id': 285192315, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052} 2025-03-12 08:59:14 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284668469, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052} 2025-03-12 08:59:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34052&page=1> {'review': '', 'review_id': 284668469, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052} 2025-03-12 08:59:14 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284563104, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052} 2025-03-12 08:59:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34052&page=1> {'review': '', 'review_id': 284563104, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052} 2025-03-12 08:59:14 [reviews] INFO: Scraped item: {'review': 'spicy and tasty ', 'review_id': 284553663, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052} 2025-03-12 08:59:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34052&page=1> {'review': 'spicy and tasty ', 'review_id': 284553663, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052} 2025-03-12 08:59:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 08:59:16 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741769939, 'download_latency': 1.2726304531097412, 'depth': 0} 2025-03-12 08:59:16 [reviews] INFO: Scraped item: {'review': 'Fantastic service by Zomato', 'review_id': 285217312, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157} 2025-03-12 08:59:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34157&page=1> {'review': 'Fantastic service by Zomato', 'review_id': 285217312, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157} 2025-03-12 08:59:16 [reviews] INFO: Scraped item: {'review': 'yuk', 'review_id': 284873893, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157} 2025-03-12 08:59:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34157&page=1> {'review': 'yuk', 'review_id': 284873893, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157} 2025-03-12 08:59:16 [reviews] INFO: Scraped item: {'review': 'hi I ordered 3 chrispy spinach I got the 2 packets of the chicken but got sent only 1 pack of the spinach this is not done ', 'review_id': 284861511, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157} 2025-03-12 08:59:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34157&page=1> {'review': 'hi I ordered 3 chrispy spinach I got the 2 packets of the chicken but got sent only 1 pack of the spinach this is not done ', 'review_id': 284861511, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157} 2025-03-12 08:59:16 [reviews] INFO: Scraped item: {'review': 'Below average food', 'review_id': 284659188, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157} 2025-03-12 08:59:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34157&page=1> {'review': 'Below average food', 'review_id': 284659188, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157} 2025-03-12 08:59:16 [reviews] INFO: Scraped item: {'review': 'It tasted good .Thanks', 'review_id': 284538924, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157} 2025-03-12 08:59:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34157&page=1> {'review': 'It tasted good .Thanks', 'review_id': 284538924, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157} 2025-03-12 08:59:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 08:59:19 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741769939, 'download_latency': 1.2784793376922607, 'depth': 0} 2025-03-12 08:59:19 [reviews] INFO: Scraped item: {'review': "food was bad, biryani barely had any rice. I didn't order it to just have masala. ", 'review_id': 285225676, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269} 2025-03-12 08:59:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34269&page=1> {'review': "food was bad, biryani barely had any rice. I didn't order it to just have masala. ", 'review_id': 285225676, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269} 2025-03-12 08:59:19 [reviews] INFO: Scraped item: {'review': '', 'review_id': 285224021, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269} 2025-03-12 08:59:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34269&page=1> {'review': '', 'review_id': 285224021, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269} 2025-03-12 08:59:19 [reviews] INFO: Scraped item: {'review': 'Kheema which was ordered was tasteless.', 'review_id': 285215422, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269} 2025-03-12 08:59:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34269&page=1> {'review': 'Kheema which was ordered was tasteless.', 'review_id': 285215422, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269} 2025-03-12 08:59:19 [reviews] INFO: Scraped item: {'review': 'stale', 'review_id': 285207846, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269} 2025-03-12 08:59:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34269&page=1> {'review': 'stale', 'review_id': 285207846, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269} 2025-03-12 08:59:19 [reviews] INFO: Scraped item: {'review': 'Tried the Ramadan delivery specials, and the service was impressive! The dishes were delicious and arrived promptly, making Iftar both flavourful and satisfying.', 'review_id': 285141027, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269} 2025-03-12 08:59:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34269&page=1> {'review': 'Tried the Ramadan delivery specials, and the service was impressive! The dishes were delicious and arrived promptly, making Iftar both flavourful and satisfying.', 'review_id': 285141027, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269} 2025-03-12 08:59:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 08:59:23 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 0, 'brand_name': 'Kailash Parbat ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 34410, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741769939, 'download_latency': 1.2713947296142578, 'depth': 0} 2025-03-12 08:59:23 [reviews] INFO: Scraped item: {'review': 'There was no malai in the lassi.', 'review_id': 284440604, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 0, 'brand_name': 'Kailash Parbat ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 34410} 2025-03-12 08:59:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34410&page=1> {'review': 'There was no malai in the lassi.', 'review_id': 284440604, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 0, 'brand_name': 'Kailash Parbat ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 34410} 2025-03-12 08:59:23 [reviews] INFO: Stopping for res_id: 34410 as reviews are older than 7 days. 2025-03-12 08:59:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-12 08:59:27 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-12 08:59:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 08:59:28 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741769939, 'download_latency': 1.1147913932800293, 'depth': 0} 2025-03-12 08:59:28 [reviews] INFO: Scraped item: {'review': 'my stomach got upset, and it was a quality issue, it happen first time.', 'review_id': 285079035, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777} 2025-03-12 08:59:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34777&page=1> {'review': 'my stomach got upset, and it was a quality issue, it happen first time.', 'review_id': 285079035, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777} 2025-03-12 08:59:28 [reviews] INFO: Scraped item: {'review': "Chicken Szechwan was super hot n spicy...couldn't eat much", 'review_id': 284857177, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777} 2025-03-12 08:59:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34777&page=1> {'review': "Chicken Szechwan was super hot n spicy...couldn't eat much", 'review_id': 284857177, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777} 2025-03-12 08:59:28 [reviews] INFO: Scraped item: {'review': "i ordered full plate but received only half plate I mean it's not quantity worth the price I paid I have eaten in their restaurant they got good quantity but why half quantity in parcel", 'review_id': 284683927, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777} 2025-03-12 08:59:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34777&page=1> {'review': "i ordered full plate but received only half plate I mean it's not quantity worth the price I paid I have eaten in their restaurant they got good quantity but why half quantity in parcel", 'review_id': 284683927, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777} 2025-03-12 08:59:28 [reviews] INFO: Scraped item: {'review': 'The lollypop pieces are really small and not worth the price. very disappointed ', 'review_id': 284318599, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777} 2025-03-12 08:59:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34777&page=1> {'review': 'The lollypop pieces are really small and not worth the price. very disappointed ', 'review_id': 284318599, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777} 2025-03-12 08:59:28 [reviews] INFO: Scraped item: {'review': 'The Fried rice was like pot rice and the Manchuria was salty.', 'review_id': 284145078, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777} 2025-03-12 08:59:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34777&page=1> {'review': 'The Fried rice was like pot rice and the Manchuria was salty.', 'review_id': 284145078, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777} 2025-03-12 08:59:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 08:59:32 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 73, 'brand_name': 'Fire Bowl', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 34810, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741769939, 'download_latency': 1.5016798973083496, 'depth': 0} 2025-03-12 08:59:32 [reviews] INFO: Scraped item: {'review': 'good gravy', 'review_id': 284636335, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 73, 'brand_name': 'Fire Bowl', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 34810} 2025-03-12 08:59:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34810&page=1> {'review': 'good gravy', 'review_id': 284636335, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 73, 'brand_name': 'Fire Bowl', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 34810} 2025-03-12 08:59:32 [reviews] INFO: Scraped item: {'review': "utterly nonsense dish, I have had oyster sauce chicken in many places and it's usually prepared in black sauce and is not very spicy but this is totally different made in red sauce like shezwan chicken and extremely spicy don't order", 'review_id': 284080111, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 73, 'brand_name': 'Fire Bowl', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 34810} 2025-03-12 08:59:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34810&page=1> {'review': "utterly nonsense dish, I have had oyster sauce chicken in many places and it's usually prepared in black sauce and is not very spicy but this is totally different made in red sauce like shezwan chicken and extremely spicy don't order", 'review_id': 284080111, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 73, 'brand_name': 'Fire Bowl', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 34810} 2025-03-12 08:59:32 [reviews] INFO: Scraped item: {'review': 'Bad stale chicken n prawns!', 'review_id': 283436442, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 73, 'brand_name': 'Fire Bowl', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 34810} 2025-03-12 08:59:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34810&page=1> {'review': 'Bad stale chicken n prawns!', 'review_id': 283436442, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 73, 'brand_name': 'Fire Bowl', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 34810} 2025-03-12 08:59:32 [reviews] INFO: Stopping for res_id: 34810 as reviews are older than 7 days. 2025-03-12 08:59:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 08:59:36 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741769939, 'download_latency': 1.1306133270263672, 'depth': 0} 2025-03-12 08:59:36 [reviews] INFO: Scraped item: {'review': 'I had ordered mutton biryani. Chicken biryani came by mistake.', 'review_id': 284914770, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844} 2025-03-12 08:59:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34844&page=1> {'review': 'I had ordered mutton biryani. Chicken biryani came by mistake.', 'review_id': 284914770, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844} 2025-03-12 08:59:36 [reviews] INFO: Scraped item: {'review': 'The mutton biryani was amazing. Proper pieces of mutton and my special request for more of white rice was taken care of.', 'review_id': 284613910, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844} 2025-03-12 08:59:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34844&page=1> {'review': 'The mutton biryani was amazing. Proper pieces of mutton and my special request for more of white rice was taken care of.', 'review_id': 284613910, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844} 2025-03-12 08:59:36 [reviews] INFO: Scraped item: {'review': "the worst restaurant . ordered egg bhurji but got delivered egg afgani. happened to me twice. won't order from this restaurant again", 'review_id': 284497410, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844} 2025-03-12 08:59:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34844&page=1> {'review': "the worst restaurant . ordered egg bhurji but got delivered egg afgani. happened to me twice. won't order from this restaurant again", 'review_id': 284497410, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844} 2025-03-12 08:59:36 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284286475, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844} 2025-03-12 08:59:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34844&page=1> {'review': '', 'review_id': 284286475, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844} 2025-03-12 08:59:36 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283941543, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844} 2025-03-12 08:59:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34844&page=1> {'review': '', 'review_id': 283941543, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844} 2025-03-12 08:59:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 08:59:41 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 80, 'brand_name': 'Mainland China', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 35232, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741769939, 'download_latency': 1.2643311023712158, 'depth': 0} 2025-03-12 08:59:41 [reviews] INFO: Scraped item: {'review': 'very poor quality of food, spring roll was pathetic, noodles were ok, exotic vegetables were also not good. better to avoid.', 'review_id': 285119768, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 80, 'brand_name': 'Mainland China', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 35232} 2025-03-12 08:59:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=35232&page=1> {'review': 'very poor quality of food, spring roll was pathetic, noodles were ok, exotic vegetables were also not good. better to avoid.', 'review_id': 285119768, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 80, 'brand_name': 'Mainland China', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 35232} 2025-03-12 08:59:41 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284273066, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 80, 'brand_name': 'Mainland China', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 35232} 2025-03-12 08:59:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=35232&page=1> {'review': '', 'review_id': 284273066, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 80, 'brand_name': 'Mainland China', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 35232} 2025-03-12 08:59:41 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283412129, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 80, 'brand_name': 'Mainland China', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 35232} 2025-03-12 08:59:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=35232&page=1> {'review': '', 'review_id': 283412129, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 80, 'brand_name': 'Mainland China', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 35232} 2025-03-12 08:59:41 [reviews] INFO: Stopping for res_id: 35232 as reviews are older than 7 days. 2025-03-12 08:59:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-12 08:59:42 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-12 08:59:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 08:59:45 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 0, 'brand_name': 'New yorker', 'city': 'Mumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 36164, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741769939, 'download_latency': 1.8147716522216797, 'depth': 0} 2025-03-12 08:59:45 [reviews] INFO: Scraped item: {'review': 'very poor quality food for such a high price. very disappointed. the soup was sugary sweet. the cheese on the pizza seemed very poor quality (cheewe and rubbery) pizza lacked flavour. felt like the sweet soup was the pizza sauce. very poor quality. will never order nor recommend this restaurant to anyone ever. ', 'review_id': 284327132, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 0, 'brand_name': 'New yorker', 'city': 'Mumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 36164} 2025-03-12 08:59:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36164&page=1> {'review': 'very poor quality food for such a high price. very disappointed. the soup was sugary sweet. the cheese on the pizza seemed very poor quality (cheewe and rubbery) pizza lacked flavour. felt like the sweet soup was the pizza sauce. very poor quality. will never order nor recommend this restaurant to anyone ever. ', 'review_id': 284327132, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 0, 'brand_name': 'New yorker', 'city': 'Mumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 36164} 2025-03-12 08:59:45 [reviews] INFO: Stopping for res_id: 36164 as reviews are older than 7 days. 2025-03-12 08:59:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 08:59:50 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 61, 'brand_name': "Mom's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 36226, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741769939, 'download_latency': 2.074721574783325, 'depth': 0} 2025-03-12 08:59:50 [reviews] INFO: Scraped item: {'review': 'very good food ', 'review_id': 285218237, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 61, 'brand_name': "Mom's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 36226} 2025-03-12 08:59:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36226&page=1> {'review': 'very good food ', 'review_id': 285218237, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 61, 'brand_name': "Mom's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 36226} 2025-03-12 08:59:50 [reviews] INFO: Scraped item: {'review': '2 pieces of the paneer in the paneer chilli were spoilt.. it gave a spoilt taste...', 'review_id': 285164037, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 61, 'brand_name': "Mom's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 36226} 2025-03-12 08:59:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36226&page=1> {'review': '2 pieces of the paneer in the paneer chilli were spoilt.. it gave a spoilt taste...', 'review_id': 285164037, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 61, 'brand_name': "Mom's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 36226} 2025-03-12 08:59:50 [reviews] INFO: Scraped item: {'review': 'fried rice had eggshell in it.', 'review_id': 284909981, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 61, 'brand_name': "Mom's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 36226} 2025-03-12 08:59:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36226&page=1> {'review': 'fried rice had eggshell in it.', 'review_id': 284909981, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 61, 'brand_name': "Mom's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 36226} 2025-03-12 08:59:50 [reviews] INFO: Scraped item: {'review': 'awesome quantity and taste ', 'review_id': 284898596, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 61, 'brand_name': "Mom's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 36226} 2025-03-12 08:59:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36226&page=1> {'review': 'awesome quantity and taste ', 'review_id': 284898596, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 61, 'brand_name': "Mom's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 36226} 2025-03-12 08:59:50 [reviews] INFO: Stopping for res_id: 36226 as reviews are older than 7 days. 2025-03-12 08:59:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 08:59:53 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741769939, 'download_latency': 1.3454124927520752, 'depth': 0} 2025-03-12 08:59:53 [reviews] INFO: Scraped item: {'review': '', 'review_id': 285024492, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291} 2025-03-12 08:59:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36291&page=1> {'review': '', 'review_id': 285024492, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291} 2025-03-12 08:59:53 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283940760, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291} 2025-03-12 08:59:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36291&page=1> {'review': '', 'review_id': 283940760, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291} 2025-03-12 08:59:53 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283602061, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291} 2025-03-12 08:59:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36291&page=1> {'review': '', 'review_id': 283602061, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291} 2025-03-12 08:59:53 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283249018, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291} 2025-03-12 08:59:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36291&page=1> {'review': '', 'review_id': 283249018, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291} 2025-03-12 08:59:53 [reviews] INFO: Stopping for res_id: 36291 as reviews are older than 7 days. 2025-03-12 08:59:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-12 08:59:57 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-12 08:59:57 [scrapy.extensions.logstats] INFO: Crawled 15 pages (at 15 pages/min), scraped 56 items (at 56 items/min) 2025-03-12 08:59:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 08:59:58 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 79, 'brand_name': 'China Gate', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 36299, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741769939, 'download_latency': 1.2134017944335938, 'depth': 0} 2025-03-12 08:59:58 [reviews] INFO: Scraped item: {'review': 'no crispy noodles sent with manchow soup', 'review_id': 284044637, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 79, 'brand_name': 'China Gate', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 36299} 2025-03-12 08:59:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36299&page=1> {'review': 'no crispy noodles sent with manchow soup', 'review_id': 284044637, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 79, 'brand_name': 'China Gate', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 36299} 2025-03-12 08:59:58 [reviews] INFO: Scraped item: {'review': 'Excellent food as usual
Corn and Water chestnuts + crispy spinach w/paneer, baby corn & mushroom as starters were very good. We requested the spinach to not be sweet and they accommodated our request.

Three treasure vegetables in Hunan sauce, Vegetarian pepper corn fried rice and vegetarian teppanyaki noodle as entrees hit the spot. Generous portions, flavorful food, excellent service from Chandan and staff! Will definitely repeat!', 'review_id': 283394396, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-06', 'competitor_id': 79, 'brand_name': 'China Gate', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 36299} 2025-03-12 08:59:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36299&page=1> {'review': 'Excellent food as usual
Corn and Water chestnuts + crispy spinach w/paneer, baby corn & mushroom as starters were very good. We requested the spinach to not be sweet and they accommodated our request.

Three treasure vegetables in Hunan sauce, Vegetarian pepper corn fried rice and vegetarian teppanyaki noodle as entrees hit the spot. Generous portions, flavorful food, excellent service from Chandan and staff! Will definitely repeat!', 'review_id': 283394396, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-06', 'competitor_id': 79, 'brand_name': 'China Gate', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 36299} 2025-03-12 08:59:58 [reviews] INFO: Scraped item: {'review': 'Had the most horrible experience with this restaurant.', 'review_id': 283209878, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 79, 'brand_name': 'China Gate', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 36299} 2025-03-12 08:59:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36299&page=1> {'review': 'Had the most horrible experience with this restaurant.', 'review_id': 283209878, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 79, 'brand_name': 'China Gate', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 36299} 2025-03-12 08:59:58 [reviews] INFO: Stopping for res_id: 36299 as reviews are older than 7 days. 2025-03-12 09:00:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:00:02 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 9, 'brand_name': 'Status', 'city': 'Mumbai', 'sub_zone': 'Nariman Point', 'platform': 'zomato', 'res_id': 37459, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741769941, 'download_latency': 1.4877099990844727, 'depth': 0} 2025-03-12 09:00:02 [reviews] INFO: Scraped item: {'review': 'all the food was extremely sweet', 'review_id': 285238987, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-12', 'competitor_id': 9, 'brand_name': 'Status', 'city': 'Mumbai', 'sub_zone': 'Nariman Point', 'platform': 'zomato', 'res_id': 37459} 2025-03-12 09:00:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37459&page=1> {'review': 'all the food was extremely sweet', 'review_id': 285238987, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-12', 'competitor_id': 9, 'brand_name': 'Status', 'city': 'Mumbai', 'sub_zone': 'Nariman Point', 'platform': 'zomato', 'res_id': 37459} 2025-03-12 09:00:02 [reviews] INFO: Scraped item: {'review': 'Food service everything is just amazing the kashmiri paratha and paneer biryani are my favourite here', 'review_id': 284813429, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 9, 'brand_name': 'Status', 'city': 'Mumbai', 'sub_zone': 'Nariman Point', 'platform': 'zomato', 'res_id': 37459} 2025-03-12 09:00:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37459&page=1> {'review': 'Food service everything is just amazing the kashmiri paratha and paneer biryani are my favourite here', 'review_id': 284813429, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 9, 'brand_name': 'Status', 'city': 'Mumbai', 'sub_zone': 'Nariman Point', 'platform': 'zomato', 'res_id': 37459} 2025-03-12 09:00:02 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284317445, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 9, 'brand_name': 'Status', 'city': 'Mumbai', 'sub_zone': 'Nariman Point', 'platform': 'zomato', 'res_id': 37459} 2025-03-12 09:00:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37459&page=1> {'review': '', 'review_id': 284317445, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 9, 'brand_name': 'Status', 'city': 'Mumbai', 'sub_zone': 'Nariman Point', 'platform': 'zomato', 'res_id': 37459} 2025-03-12 09:00:02 [reviews] INFO: Scraped item: {'review': 'Too spicy despite requesting', 'review_id': 283250882, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 9, 'brand_name': 'Status', 'city': 'Mumbai', 'sub_zone': 'Nariman Point', 'platform': 'zomato', 'res_id': 37459} 2025-03-12 09:00:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37459&page=1> {'review': 'Too spicy despite requesting', 'review_id': 283250882, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 9, 'brand_name': 'Status', 'city': 'Mumbai', 'sub_zone': 'Nariman Point', 'platform': 'zomato', 'res_id': 37459} 2025-03-12 09:00:02 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283212857, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 9, 'brand_name': 'Status', 'city': 'Mumbai', 'sub_zone': 'Nariman Point', 'platform': 'zomato', 'res_id': 37459} 2025-03-12 09:00:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37459&page=1> {'review': '', 'review_id': 283212857, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 9, 'brand_name': 'Status', 'city': 'Mumbai', 'sub_zone': 'Nariman Point', 'platform': 'zomato', 'res_id': 37459} 2025-03-12 09:00:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:00:06 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741769943, 'download_latency': 1.299177885055542, 'depth': 0} 2025-03-12 09:00:06 [reviews] INFO: Scraped item: {'review': '', 'review_id': 285152379, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679} 2025-03-12 09:00:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37679&page=1> {'review': '', 'review_id': 285152379, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679} 2025-03-12 09:00:06 [reviews] INFO: Scraped item: {'review': 'good service, good quality food!!', 'review_id': 285134969, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679} 2025-03-12 09:00:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37679&page=1> {'review': 'good service, good quality food!!', 'review_id': 285134969, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679} 2025-03-12 09:00:06 [reviews] INFO: Scraped item: {'review': 'The daal is stale - very disappointing experience. The order reached 30 minutes late', 'review_id': 285106346, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679} 2025-03-12 09:00:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37679&page=1> {'review': 'The daal is stale - very disappointing experience. The order reached 30 minutes late', 'review_id': 285106346, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679} 2025-03-12 09:00:06 [reviews] INFO: Scraped item: {'review': 'As always the food was yummy! Satyendra Negi was very good at service. They made me try a new variety of tacos and salsa and that was very good too.', 'review_id': 284985346, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679} 2025-03-12 09:00:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37679&page=1> {'review': 'As always the food was yummy! Satyendra Negi was very good at service. They made me try a new variety of tacos and salsa and that was very good too.', 'review_id': 284985346, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679} 2025-03-12 09:00:06 [reviews] INFO: Scraped item: {'review': 'Good sevice Sanjay', 'review_id': 284829777, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679} 2025-03-12 09:00:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37679&page=1> {'review': 'Good sevice Sanjay', 'review_id': 284829777, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679} 2025-03-12 09:00:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:00:11 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:00:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-12 09:00:12 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-12 09:00:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:00:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:00:21 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:00:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-12 09:00:27 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-12 09:00:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:00:30 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741769968, 'download_latency': 1.1258704662322998, 'depth': 0} 2025-03-12 09:00:30 [reviews] INFO: Scraped item: {'review': 'food was just removed from refrigerator and stale food was delivered. horrible.waste of money.', 'review_id': 285036484, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823} 2025-03-12 09:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37823&page=1> {'review': 'food was just removed from refrigerator and stale food was delivered. horrible.waste of money.', 'review_id': 285036484, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823} 2025-03-12 09:00:30 [reviews] INFO: Scraped item: {'review': 'I ordered veg and non veg soup
Chicken soup was thick and authentic taste of chinese.
Veg soup was not so thick but no compromise on taste.
', 'review_id': 284991406, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823} 2025-03-12 09:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37823&page=1> {'review': 'I ordered veg and non veg soup
Chicken soup was thick and authentic taste of chinese.
Veg soup was not so thick but no compromise on taste.
', 'review_id': 284991406, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823} 2025-03-12 09:00:30 [reviews] INFO: Scraped item: {'review': 'The restaurant sent our mojito in a freaking tiffin box, no straw no tissues, crap.', 'review_id': 284604088, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823} 2025-03-12 09:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37823&page=1> {'review': 'The restaurant sent our mojito in a freaking tiffin box, no straw no tissues, crap.', 'review_id': 284604088, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823} 2025-03-12 09:00:30 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284514259, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823} 2025-03-12 09:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37823&page=1> {'review': '', 'review_id': 284514259, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823} 2025-03-12 09:00:30 [reviews] INFO: Scraped item: {'review': 'Chicken in Sapo sauce was bitter, rest all okay.', 'review_id': 283935750, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823} 2025-03-12 09:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37823&page=1> {'review': 'Chicken in Sapo sauce was bitter, rest all okay.', 'review_id': 283935750, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823} 2025-03-12 09:00:31 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:00:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:00:36 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 0, 'brand_name': 'Relish', 'city': 'Mumbai', 'sub_zone': 'Churchgate', 'platform': 'zomato', 'res_id': 37978, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741769977, 'download_latency': 0.985450267791748, 'depth': 0} 2025-03-12 09:00:36 [reviews] INFO: Scraped item: {'review': 'Though u have to wait on weekends the cheese corn ball loaded nachos and sizzlers here i worth the wait', 'review_id': 284810559, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 0, 'brand_name': 'Relish', 'city': 'Mumbai', 'sub_zone': 'Churchgate', 'platform': 'zomato', 'res_id': 37978} 2025-03-12 09:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37978&page=1> {'review': 'Though u have to wait on weekends the cheese corn ball loaded nachos and sizzlers here i worth the wait', 'review_id': 284810559, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 0, 'brand_name': 'Relish', 'city': 'Mumbai', 'sub_zone': 'Churchgate', 'platform': 'zomato', 'res_id': 37978} 2025-03-12 09:00:36 [reviews] INFO: Stopping for res_id: 37978 as reviews are older than 7 days. 2025-03-12 09:00:39 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-12 09:00:42 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-12 09:00:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:00:45 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 64, 'brand_name': "Jim - Me's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Hill Road ', 'platform': 'zomato', 'res_id': 38512, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741769986, 'download_latency': 1.2964966297149658, 'depth': 0} 2025-03-12 09:00:45 [reviews] INFO: Stopping for res_id: 38512 as reviews are older than 7 days. 2025-03-12 09:00:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:00:49 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 69, 'brand_name': 'Asian Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 38797, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741769990, 'download_latency': 1.2175767421722412, 'depth': 0} 2025-03-12 09:00:49 [reviews] INFO: Stopping for res_id: 38797 as reviews are older than 7 days. 2025-03-12 09:00:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:00:53 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'PHOENIX', 'platform': 'zomato', 'res_id': 39528, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741769994, 'download_latency': 1.2563705444335938, 'depth': 0} 2025-03-12 09:00:53 [reviews] INFO: Scraped item: {'review': 'service and food is really good.', 'review_id': 283374662, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-06', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'PHOENIX', 'platform': 'zomato', 'res_id': 39528} 2025-03-12 09:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=39528&page=1> {'review': 'service and food is really good.', 'review_id': 283374662, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-06', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'PHOENIX', 'platform': 'zomato', 'res_id': 39528} 2025-03-12 09:00:53 [reviews] INFO: Stopping for res_id: 39528 as reviews are older than 7 days. 2025-03-12 09:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-12 09:00:57 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-12 09:00:57 [scrapy.extensions.logstats] INFO: Crawled 23 pages (at 8 pages/min), scraped 76 items (at 20 items/min) 2025-03-12 09:00:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:00:57 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 39, 'brand_name': 'Yauatcha', 'city': 'Mumbai', 'sub_zone': 'Bandra Kurla Complex', 'platform': 'zomato', 'res_id': 39675, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741769998, 'download_latency': 1.3262739181518555, 'depth': 0} 2025-03-12 09:00:57 [reviews] INFO: Scraped item: {'review': '', 'review_id': 285190209, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 39, 'brand_name': 'Yauatcha', 'city': 'Mumbai', 'sub_zone': 'Bandra Kurla Complex', 'platform': 'zomato', 'res_id': 39675} 2025-03-12 09:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=39675&page=1> {'review': '', 'review_id': 285190209, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 39, 'brand_name': 'Yauatcha', 'city': 'Mumbai', 'sub_zone': 'Bandra Kurla Complex', 'platform': 'zomato', 'res_id': 39675} 2025-03-12 09:00:57 [reviews] INFO: Scraped item: {'review': 'Wonderful. Ambience great food awesome service by Saif.', 'review_id': 285140782, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 39, 'brand_name': 'Yauatcha', 'city': 'Mumbai', 'sub_zone': 'Bandra Kurla Complex', 'platform': 'zomato', 'res_id': 39675} 2025-03-12 09:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=39675&page=1> {'review': 'Wonderful. Ambience great food awesome service by Saif.', 'review_id': 285140782, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 39, 'brand_name': 'Yauatcha', 'city': 'Mumbai', 'sub_zone': 'Bandra Kurla Complex', 'platform': 'zomato', 'res_id': 39675} 2025-03-12 09:00:57 [reviews] INFO: Scraped item: {'review': 'Food 10/10
Service 10/10
Ambience 6/10
We ordered Crispy prawn cheng fun, Pork and prawn Shui Mai, Egg Chicken Ramen, Braised Chicken Water Chestnut chilli, Peach Ice Tea and Chilli Guava. Everything was so good. Raspberry and Chocolate Delice was yummmm.', 'review_id': 284909584, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 39, 'brand_name': 'Yauatcha', 'city': 'Mumbai', 'sub_zone': 'Bandra Kurla Complex', 'platform': 'zomato', 'res_id': 39675} 2025-03-12 09:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=39675&page=1> {'review': 'Food 10/10
Service 10/10
Ambience 6/10
We ordered Crispy prawn cheng fun, Pork and prawn Shui Mai, Egg Chicken Ramen, Braised Chicken Water Chestnut chilli, Peach Ice Tea and Chilli Guava. Everything was so good. Raspberry and Chocolate Delice was yummmm.', 'review_id': 284909584, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 39, 'brand_name': 'Yauatcha', 'city': 'Mumbai', 'sub_zone': 'Bandra Kurla Complex', 'platform': 'zomato', 'res_id': 39675} 2025-03-12 09:00:57 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284523884, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 39, 'brand_name': 'Yauatcha', 'city': 'Mumbai', 'sub_zone': 'Bandra Kurla Complex', 'platform': 'zomato', 'res_id': 39675} 2025-03-12 09:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=39675&page=1> {'review': '', 'review_id': 284523884, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 39, 'brand_name': 'Yauatcha', 'city': 'Mumbai', 'sub_zone': 'Bandra Kurla Complex', 'platform': 'zomato', 'res_id': 39675} 2025-03-12 09:00:57 [reviews] INFO: Scraped item: {'review': 'Really impressed with the service by saif and nikhil thanks to you both', 'review_id': 284167556, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 39, 'brand_name': 'Yauatcha', 'city': 'Mumbai', 'sub_zone': 'Bandra Kurla Complex', 'platform': 'zomato', 'res_id': 39675} 2025-03-12 09:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=39675&page=1> {'review': 'Really impressed with the service by saif and nikhil thanks to you both', 'review_id': 284167556, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 39, 'brand_name': 'Yauatcha', 'city': 'Mumbai', 'sub_zone': 'Bandra Kurla Complex', 'platform': 'zomato', 'res_id': 39675} 2025-03-12 09:01:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:01:02 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770003, 'download_latency': 2.247513771057129, 'depth': 0} 2025-03-12 09:01:02 [reviews] INFO: Scraped item: {'review': 'This time the food was very unusually teekha', 'review_id': 284774896, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083} 2025-03-12 09:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=40083&page=1> {'review': 'This time the food was very unusually teekha', 'review_id': 284774896, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083} 2025-03-12 09:01:02 [reviews] INFO: Scraped item: {'review': 'good quality and quantity ', 'review_id': 284456772, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083} 2025-03-12 09:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=40083&page=1> {'review': 'good quality and quantity ', 'review_id': 284456772, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083} 2025-03-12 09:01:02 [reviews] INFO: Scraped item: {'review': 'Schezwan kharab hua mila 4 packets the sab kharab combination rice dish mai n triple Schezwan rice mai bs egg ka difference tha baki koi difference nhi aisa laga chaval n noodles ko garam karke usmai chicken egg n oil red color dalkr dediya bs very disappointed guys gharpe sabka mood off bcz off u guys', 'review_id': 284122447, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083} 2025-03-12 09:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=40083&page=1> {'review': 'Schezwan kharab hua mila 4 packets the sab kharab combination rice dish mai n triple Schezwan rice mai bs egg ka difference tha baki koi difference nhi aisa laga chaval n noodles ko garam karke usmai chicken egg n oil red color dalkr dediya bs very disappointed guys gharpe sabka mood off bcz off u guys', 'review_id': 284122447, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083} 2025-03-12 09:01:02 [reviews] INFO: Scraped item: {'review': 'there was 3 lollipop in description but delivered only 2 pieces. what is this ??', 'review_id': 283568613, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083} 2025-03-12 09:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=40083&page=1> {'review': 'there was 3 lollipop in description but delivered only 2 pieces. what is this ??', 'review_id': 283568613, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083} 2025-03-12 09:01:02 [reviews] INFO: Stopping for res_id: 40083 as reviews are older than 7 days. 2025-03-12 09:01:04 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:01:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:01:11 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:01:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:01:17 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:01:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:01:23 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-12 09:01:27 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-12 09:01:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:01:30 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:01:33 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:01:35 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:01:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:01:40 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770045, 'download_latency': 0.7261340618133545, 'depth': 0} 2025-03-12 09:01:40 [reviews] INFO: Scraped item: {'review': 'Awesome ', 'review_id': 284604319, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143} 2025-03-12 09:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=41143&page=1> {'review': 'Awesome ', 'review_id': 284604319, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143} 2025-03-12 09:01:40 [reviews] INFO: Scraped item: {'review': 'The food was delayed by almost an hr. and the food taste was not at all good ', 'review_id': 284581394, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143} 2025-03-12 09:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=41143&page=1> {'review': 'The food was delayed by almost an hr. and the food taste was not at all good ', 'review_id': 284581394, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143} 2025-03-12 09:01:40 [reviews] INFO: Scraped item: {'review': 'Water chestnut was a disaster..we actually dint eat at all', 'review_id': 284368496, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143} 2025-03-12 09:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=41143&page=1> {'review': 'Water chestnut was a disaster..we actually dint eat at all', 'review_id': 284368496, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143} 2025-03-12 09:01:40 [reviews] INFO: Scraped item: {'review': 'Delay in preparation', 'review_id': 284071217, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143} 2025-03-12 09:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=41143&page=1> {'review': 'Delay in preparation', 'review_id': 284071217, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143} 2025-03-12 09:01:40 [reviews] INFO: Scraped item: {'review': 'undercooked food', 'review_id': 284032890, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143} 2025-03-12 09:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=41143&page=1> {'review': 'undercooked food', 'review_id': 284032890, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143} 2025-03-12 09:01:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:01:45 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 63, 'brand_name': 'Cocoon- Dragonfly Hotel', 'city': 'Mumbai', 'sub_zone': 'Chakala', 'platform': 'zomato', 'res_id': 42630, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770049, 'download_latency': 0.8363511562347412, 'depth': 0} 2025-03-12 09:01:45 [reviews] INFO: Stopping for res_id: 42630 as reviews are older than 7 days. 2025-03-12 09:01:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:01:49 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 66, 'brand_name': 'Red Chilli', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 42695, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770053, 'download_latency': 0.6988787651062012, 'depth': 0} 2025-03-12 09:01:49 [reviews] INFO: Stopping for res_id: 42695 as reviews are older than 7 days. 2025-03-12 09:01:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:01:53 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'RCITY', 'platform': 'zomato', 'res_id': 43965, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770057, 'download_latency': 0.7363317012786865, 'depth': 0} 2025-03-12 09:01:53 [reviews] ERROR: Unrecognized relative_date format: 43 minutes ago 2025-03-12 09:01:53 [reviews] INFO: Stopping for res_id: 43965 due to unrecognized date format: 43 minutes ago. 2025-03-12 09:01:56 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-12 09:01:57 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-12 09:01:57 [scrapy.extensions.logstats] INFO: Crawled 29 pages (at 6 pages/min), scraped 90 items (at 14 items/min) 2025-03-12 09:01:59 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:02:04 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:02:08 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:02:12 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:02:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:02:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:02:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:02:26 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-12 09:02:27 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-12 09:02:28 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:02:33 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:02:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:02:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:02:41 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770101, 'download_latency': 0.7612011432647705, 'depth': 0} 2025-03-12 09:02:41 [reviews] INFO: Scraped item: {'review': 'very good food and service , thank you Dilip Ji for wonderful time and your service and suggestions ', 'review_id': 285126830, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672} 2025-03-12 09:02:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=46672&page=1> {'review': 'very good food and service , thank you Dilip Ji for wonderful time and your service and suggestions ', 'review_id': 285126830, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672} 2025-03-12 09:02:41 [reviews] INFO: Scraped item: {'review': 'The food was very good and Mr Anil Kumar Ray suggested us honestly. The service was really good . He is humble . Thanks', 'review_id': 285039349, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672} 2025-03-12 09:02:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=46672&page=1> {'review': 'The food was very good and Mr Anil Kumar Ray suggested us honestly. The service was really good . He is humble . Thanks', 'review_id': 285039349, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672} 2025-03-12 09:02:41 [reviews] INFO: Scraped item: {'review': 'v good service ', 'review_id': 285016246, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672} 2025-03-12 09:02:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=46672&page=1> {'review': 'v good service ', 'review_id': 285016246, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672} 2025-03-12 09:02:41 [reviews] INFO: Scraped item: {'review': 'Anoop Yadav was very courteous and polite! Great service', 'review_id': 285012144, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672} 2025-03-12 09:02:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=46672&page=1> {'review': 'Anoop Yadav was very courteous and polite! Great service', 'review_id': 285012144, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672} 2025-03-12 09:02:41 [reviews] INFO: Scraped item: {'review': 'Very good', 'review_id': 285010195, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672} 2025-03-12 09:02:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=46672&page=1> {'review': 'Very good', 'review_id': 285010195, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672} 2025-03-12 09:02:44 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:02:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:02:49 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 26, 'brand_name': 'Starbucks Coffee', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 47111, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770109, 'download_latency': 0.6938571929931641, 'depth': 0} 2025-03-12 09:02:49 [reviews] INFO: Stopping for res_id: 47111 as reviews are older than 7 days. 2025-03-12 09:02:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:02:52 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770114, 'download_latency': 1.1299443244934082, 'depth': 0} 2025-03-12 09:02:52 [reviews] INFO: Scraped item: {'review': 'The rice was raw...and taste was not that good as it was last time...you always prepare tasty but this time it was very bad.', 'review_id': 285039018, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171} 2025-03-12 09:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47171&page=1> {'review': 'The rice was raw...and taste was not that good as it was last time...you always prepare tasty but this time it was very bad.', 'review_id': 285039018, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171} 2025-03-12 09:02:52 [reviews] INFO: Scraped item: {'review': 'Abhor it fear it and do not order from it..My stomach is upset after eating their paneer', 'review_id': 284916215, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171} 2025-03-12 09:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47171&page=1> {'review': 'Abhor it fear it and do not order from it..My stomach is upset after eating their paneer', 'review_id': 284916215, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171} 2025-03-12 09:02:52 [reviews] INFO: Scraped item: {'review': 'Crispy corn was not at all crispy when it reached home. And kung pao chicken was sweet dint like the taste', 'review_id': 284616513, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171} 2025-03-12 09:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47171&page=1> {'review': 'Crispy corn was not at all crispy when it reached home. And kung pao chicken was sweet dint like the taste', 'review_id': 284616513, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171} 2025-03-12 09:02:52 [reviews] INFO: Scraped item: {'review': 'Amazing taste and quality', 'review_id': 284599376, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171} 2025-03-12 09:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47171&page=1> {'review': 'Amazing taste and quality', 'review_id': 284599376, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171} 2025-03-12 09:02:52 [reviews] INFO: Scraped item: {'review': 'Very bland and makes the stomach a little upset', 'review_id': 284154906, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171} 2025-03-12 09:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47171&page=1> {'review': 'Very bland and makes the stomach a little upset', 'review_id': 284154906, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171} 2025-03-12 09:02:56 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-12 09:02:57 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-12 09:02:57 [scrapy.extensions.logstats] INFO: Crawled 32 pages (at 3 pages/min), scraped 100 items (at 10 items/min) 2025-03-12 09:03:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:03:03 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:03:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:03:11 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:03:15 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:03:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:03:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:03:25 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-12 09:03:27 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-12 09:03:29 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:03:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:03:35 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:03:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:03:40 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770161, 'download_latency': 1.5888943672180176, 'depth': 0} 2025-03-12 09:03:40 [reviews] INFO: Scraped item: {'review': "worst food ever had waste of money and time I have Oder food 1 clock I get my order 3 clock and the taste and quality was worst don't order food anytime from this hotel ", 'review_id': 285223975, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458} 2025-03-12 09:03:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47458&page=1> {'review': "worst food ever had waste of money and time I have Oder food 1 clock I get my order 3 clock and the taste and quality was worst don't order food anytime from this hotel ", 'review_id': 285223975, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458} 2025-03-12 09:03:40 [reviews] INFO: Scraped item: {'review': "Gravy was not upto the mark but I'm glad the food was delivered hot and fresh", 'review_id': 285222171, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458} 2025-03-12 09:03:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47458&page=1> {'review': "Gravy was not upto the mark but I'm glad the food was delivered hot and fresh", 'review_id': 285222171, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458} 2025-03-12 09:03:40 [reviews] INFO: Scraped item: {'review': 'Pathetic. They were not the same which I ate when I visited their restaurant.', 'review_id': 285203043, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458} 2025-03-12 09:03:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47458&page=1> {'review': 'Pathetic. They were not the same which I ate when I visited their restaurant.', 'review_id': 285203043, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458} 2025-03-12 09:03:40 [reviews] INFO: Scraped item: {'review': 'the food was cold . ', 'review_id': 285201313, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458} 2025-03-12 09:03:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47458&page=1> {'review': 'the food was cold . ', 'review_id': 285201313, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458} 2025-03-12 09:03:40 [reviews] INFO: Scraped item: {'review': 'Chicken was overcooked and inedible', 'review_id': 285122116, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458} 2025-03-12 09:03:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47458&page=1> {'review': 'Chicken was overcooked and inedible', 'review_id': 285122116, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458} 2025-03-12 09:03:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:03:45 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:03:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:03:48 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Matunga East', 'platform': 'zomato', 'res_id': 48066, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770173, 'download_latency': 1.0556395053863525, 'depth': 0} 2025-03-12 09:03:48 [reviews] ERROR: Unrecognized relative_date format: nov 18, 2022 2025-03-12 09:03:48 [reviews] INFO: Stopping for res_id: 48066 due to unrecognized date format: Nov 18, 2022. 2025-03-12 09:03:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:03:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-12 09:03:57 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-12 09:03:57 [scrapy.extensions.logstats] INFO: Crawled 34 pages (at 2 pages/min), scraped 105 items (at 5 items/min) 2025-03-12 09:03:59 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:04:01 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:04:04 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:04:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:04:11 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:04:15 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:04:19 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:04:23 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-12 09:04:27 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-12 09:04:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:04:31 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:04:35 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:04:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:04:43 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:04:47 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:04:51 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:04:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-12 09:04:57 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-12 09:04:57 [scrapy.extensions.logstats] INFO: Crawled 34 pages (at 0 pages/min), scraped 105 items (at 0 items/min) 2025-03-12 09:04:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:05:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:05:06 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:05:09 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:05:12 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:05:16 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:05:19 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:05:23 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-12 09:05:27 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-12 09:05:27 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:05:31 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:05:35 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:05:39 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:05:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:05:44 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:05:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:05:52 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:05:56 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-12 09:05:57 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-12 09:05:57 [scrapy.extensions.logstats] INFO: Crawled 34 pages (at 0 pages/min), scraped 105 items (at 0 items/min) 2025-03-12 09:05:59 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:06:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:06:04 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770306, 'download_latency': 1.7243421077728271, 'depth': 0} 2025-03-12 09:06:04 [reviews] INFO: Scraped item: {'review': 'ordered pudding but sent other item', 'review_id': 285210507, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323} 2025-03-12 09:06:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=48323&page=1> {'review': 'ordered pudding but sent other item', 'review_id': 285210507, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323} 2025-03-12 09:06:04 [reviews] INFO: Scraped item: {'review': 'both the fried rice and butter chicken was not the way written and was tasteless', 'review_id': 285194629, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323} 2025-03-12 09:06:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=48323&page=1> {'review': 'both the fried rice and butter chicken was not the way written and was tasteless', 'review_id': 285194629, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323} 2025-03-12 09:06:04 [reviews] INFO: Scraped item: {'review': 'Ordered during Ramadan, and the delivery was both quick and reliable! The dishes were flavorful and came in safe packaging that was well-sealed.', 'review_id': 285189643, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323} 2025-03-12 09:06:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=48323&page=1> {'review': 'Ordered during Ramadan, and the delivery was both quick and reliable! The dishes were flavorful and came in safe packaging that was well-sealed.', 'review_id': 285189643, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323} 2025-03-12 09:06:04 [reviews] INFO: Scraped item: {'review': 'very poorly made masala, lacks the spice and moisture it usually has. im a regular customer but really disappointed with this order', 'review_id': 285146710, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323} 2025-03-12 09:06:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=48323&page=1> {'review': 'very poorly made masala, lacks the spice and moisture it usually has. im a regular customer but really disappointed with this order', 'review_id': 285146710, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323} 2025-03-12 09:06:04 [reviews] INFO: Scraped item: {'review': '“Tried Persian Darbar’s Ramadan specials for delivery, and it was absolutely worth it! The dishes were flavorful with generous portions, and the delivery was smooth and timely.”', 'review_id': 285082936, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323} 2025-03-12 09:06:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=48323&page=1> {'review': '“Tried Persian Darbar’s Ramadan specials for delivery, and it was absolutely worth it! The dishes were flavorful with generous portions, and the delivery was smooth and timely.”', 'review_id': 285082936, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323} 2025-03-12 09:06:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:06:07 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 70, 'brand_name': 'Wok Hei', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 48693, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770309, 'download_latency': 0.7277345657348633, 'depth': 0} 2025-03-12 09:06:07 [reviews] INFO: Scraped item: {'review': 'good offers on food menu n also mocktail drinks . food quality also good', 'review_id': 284242375, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 70, 'brand_name': 'Wok Hei', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 48693} 2025-03-12 09:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=48693&page=1> {'review': 'good offers on food menu n also mocktail drinks . food quality also good', 'review_id': 284242375, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 70, 'brand_name': 'Wok Hei', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 48693} 2025-03-12 09:06:07 [reviews] INFO: Stopping for res_id: 48693 as reviews are older than 7 days. 2025-03-12 09:06:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:06:11 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770313, 'download_latency': 0.7595782279968262, 'depth': 0} 2025-03-12 09:06:11 [reviews] INFO: Scraped item: {'review': 'noodles were sticky', 'review_id': 285220752, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608} 2025-03-12 09:06:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=49608&page=1> {'review': 'noodles were sticky', 'review_id': 285220752, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608} 2025-03-12 09:06:11 [reviews] INFO: Scraped item: {'review': 'fried rice was plain with stiff boiled chicken kinda little tasteless, noodles was full of uncooked masala ', 'review_id': 285193648, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608} 2025-03-12 09:06:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=49608&page=1> {'review': 'fried rice was plain with stiff boiled chicken kinda little tasteless, noodles was full of uncooked masala ', 'review_id': 285193648, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608} 2025-03-12 09:06:11 [reviews] INFO: Scraped item: {'review': 'Food was good but extra salty. May be cut down on the salt a bit and it will be great ', 'review_id': 285121000, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608} 2025-03-12 09:06:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=49608&page=1> {'review': 'Food was good but extra salty. May be cut down on the salt a bit and it will be great ', 'review_id': 285121000, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608} 2025-03-12 09:06:11 [reviews] INFO: Scraped item: {'review': 'Wrong product received and taste was also not up to the mark and items were missing in the parcel', 'review_id': 284627976, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608} 2025-03-12 09:06:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=49608&page=1> {'review': 'Wrong product received and taste was also not up to the mark and items were missing in the parcel', 'review_id': 284627976, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608} 2025-03-12 09:06:11 [reviews] INFO: Scraped item: {'review': 'The egg noodles were delicious ', 'review_id': 284458950, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608} 2025-03-12 09:06:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=49608&page=1> {'review': 'The egg noodles were delicious ', 'review_id': 284458950, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608} 2025-03-12 09:06:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:06:15 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770317, 'download_latency': 0.725334882736206, 'depth': 0} 2025-03-12 09:06:15 [reviews] INFO: Scraped item: {'review': 'Super Taste! Gives a feel of home - made food! ', 'review_id': 284959063, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805} 2025-03-12 09:06:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=306805&page=1> {'review': 'Super Taste! Gives a feel of home - made food! ', 'review_id': 284959063, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805} 2025-03-12 09:06:15 [reviews] INFO: Scraped item: {'review': 'very poor', 'review_id': 284903115, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805} 2025-03-12 09:06:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=306805&page=1> {'review': 'very poor', 'review_id': 284903115, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805} 2025-03-12 09:06:15 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284887702, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805} 2025-03-12 09:06:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=306805&page=1> {'review': '', 'review_id': 284887702, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805} 2025-03-12 09:06:15 [reviews] INFO: Scraped item: {'review': 'not delivered and shown delivered ', 'review_id': 284883393, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805} 2025-03-12 09:06:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=306805&page=1> {'review': 'not delivered and shown delivered ', 'review_id': 284883393, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805} 2025-03-12 09:06:15 [reviews] INFO: Scraped item: {'review': 'Just before blues I had B by kilo and that was really fresh. blues looked and tasted like briyani was cooked and they reheated, packed and delivered.', 'review_id': 284533675, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805} 2025-03-12 09:06:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=306805&page=1> {'review': 'Just before blues I had B by kilo and that was really fresh. blues looked and tasted like briyani was cooked and they reheated, packed and delivered.', 'review_id': 284533675, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805} 2025-03-12 09:06:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:06:19 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770319, 'download_latency': 0.8099582195281982, 'depth': 0} 2025-03-12 09:06:19 [reviews] INFO: Scraped item: {'review': 'Abit too spicy to my taste, although I requested to be less spicy. Ottherwise everything is superb from packaging to the freshness of ingredients. ', 'review_id': 284954740, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995} 2025-03-12 09:06:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=312995&page=1> {'review': 'Abit too spicy to my taste, although I requested to be less spicy. Ottherwise everything is superb from packaging to the freshness of ingredients. ', 'review_id': 284954740, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995} 2025-03-12 09:06:19 [reviews] INFO: Scraped item: {'review': 'mast', 'review_id': 284015320, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995} 2025-03-12 09:06:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=312995&page=1> {'review': 'mast', 'review_id': 284015320, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995} 2025-03-12 09:06:19 [reviews] INFO: Scraped item: {'review': 'The kebabs were cold and biryani was like pulao with just saffron and color in it. No taste, no flavour.', 'review_id': 283992258, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995} 2025-03-12 09:06:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=312995&page=1> {'review': 'The kebabs were cold and biryani was like pulao with just saffron and color in it. No taste, no flavour.', 'review_id': 283992258, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995} 2025-03-12 09:06:19 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283699498, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995} 2025-03-12 09:06:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=312995&page=1> {'review': '', 'review_id': 283699498, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995} 2025-03-12 09:06:19 [reviews] INFO: Scraped item: {'review': 'Not worthy', 'review_id': 283352285, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995} 2025-03-12 09:06:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=312995&page=1> {'review': 'Not worthy', 'review_id': 283352285, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995} 2025-03-12 09:06:22 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-12 09:06:27 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-12 09:06:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:06:27 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 40, 'brand_name': 'The Fatty Bao', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 17871363, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770327, 'download_latency': 0.7193706035614014, 'depth': 0} 2025-03-12 09:06:27 [reviews] INFO: Scraped item: {'review': 'No veggies but broccoli', 'review_id': 283647711, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 40, 'brand_name': 'The Fatty Bao', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 17871363} 2025-03-12 09:06:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=17871363&page=1> {'review': 'No veggies but broccoli', 'review_id': 283647711, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 40, 'brand_name': 'The Fatty Bao', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 17871363} 2025-03-12 09:06:27 [reviews] INFO: Stopping for res_id: 17871363 as reviews are older than 7 days. 2025-03-12 09:06:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:06:31 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 46, 'brand_name': 'China House - Hyatt Regency', 'city': 'Ahmedabad', 'sub_zone': 'Hyatt Regency, Ashram Road ', 'platform': 'zomato', 'res_id': 18161729, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770331, 'download_latency': 0.6893820762634277, 'depth': 0} 2025-03-12 09:06:31 [reviews] INFO: Stopping for res_id: 18161729 as reviews are older than 7 days. 2025-03-12 09:06:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:06:34 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 18165909, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770336, 'download_latency': 0.757793664932251, 'depth': 0} 2025-03-12 09:06:34 [reviews] INFO: Scraped item: {'review': 'The rasmalai was hot ! and was delayed ', 'review_id': 285209074, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 18165909} 2025-03-12 09:06:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18165909&page=1> {'review': 'The rasmalai was hot ! and was delayed ', 'review_id': 285209074, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 18165909} 2025-03-12 09:06:34 [reviews] INFO: Scraped item: {'review': 'Completely uncooked meat', 'review_id': 285205005, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 18165909} 2025-03-12 09:06:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18165909&page=1> {'review': 'Completely uncooked meat', 'review_id': 285205005, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 18165909} 2025-03-12 09:06:34 [reviews] INFO: Scraped item: {'review': 'the worst one so far eaten. chicken uncooked. biryani flavourless and bland. I have eaten many afgan biryanis, this was by far the worst. ', 'review_id': 284983012, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 18165909} 2025-03-12 09:06:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18165909&page=1> {'review': 'the worst one so far eaten. chicken uncooked. biryani flavourless and bland. I have eaten many afgan biryanis, this was by far the worst. ', 'review_id': 284983012, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 18165909} 2025-03-12 09:06:34 [reviews] INFO: Scraped item: {'review': 'chicken chunks were too hard and not cooked well', 'review_id': 284918844, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 18165909} 2025-03-12 09:06:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18165909&page=1> {'review': 'chicken chunks were too hard and not cooked well', 'review_id': 284918844, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 18165909} 2025-03-12 09:06:34 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284629713, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 18165909} 2025-03-12 09:06:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18165909&page=1> {'review': '', 'review_id': 284629713, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 18165909} 2025-03-12 09:06:37 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:06:39 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:06:43 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:06:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:06:49 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:06:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:06:53 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770356, 'download_latency': 0.6967403888702393, 'depth': 0} 2025-03-12 09:06:53 [reviews] INFO: Scraped item: {'review': 'worst haleem of year', 'review_id': 284921138, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915} 2025-03-12 09:06:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18216915&page=1> {'review': 'worst haleem of year', 'review_id': 284921138, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915} 2025-03-12 09:06:53 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284370772, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915} 2025-03-12 09:06:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18216915&page=1> {'review': '', 'review_id': 284370772, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915} 2025-03-12 09:06:53 [reviews] INFO: Scraped item: {'review': 'Biryani was yummy n hot', 'review_id': 284300564, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915} 2025-03-12 09:06:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18216915&page=1> {'review': 'Biryani was yummy n hot', 'review_id': 284300564, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915} 2025-03-12 09:06:53 [reviews] INFO: Scraped item: {'review': 'Tasty stuff. I appreciate. Thank you.', 'review_id': 284269245, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915} 2025-03-12 09:06:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18216915&page=1> {'review': 'Tasty stuff. I appreciate. Thank you.', 'review_id': 284269245, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915} 2025-03-12 09:06:53 [reviews] INFO: Scraped item: {'review': 'The chaap itself js very chewy i like it but the rice is so dry. There is literally only pieces of chaap with no gravy at all.', 'review_id': 284237976, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915} 2025-03-12 09:06:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18216915&page=1> {'review': 'The chaap itself js very chewy i like it but the rice is so dry. There is literally only pieces of chaap with no gravy at all.', 'review_id': 284237976, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915} 2025-03-12 09:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-12 09:06:57 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-12 09:06:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:06:57 [scrapy.extensions.logstats] INFO: Crawled 44 pages (at 10 pages/min), scraped 137 items (at 32 items/min) 2025-03-12 09:06:57 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Kandivali East', 'platform': 'zomato', 'res_id': 18257196, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770359, 'download_latency': 0.8022294044494629, 'depth': 0} 2025-03-12 09:06:57 [reviews] ERROR: Unrecognized relative_date format: may 27, 2021 2025-03-12 09:06:57 [reviews] INFO: Stopping for res_id: 18257196 due to unrecognized date format: May 27, 2021. 2025-03-12 09:06:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:06:59 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770365, 'download_latency': 0.8048770427703857, 'depth': 0} 2025-03-12 09:06:59 [reviews] INFO: Scraped item: {'review': 'chicken was chewy and over salted', 'review_id': 285181425, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118} 2025-03-12 09:06:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18324118&page=1> {'review': 'chicken was chewy and over salted', 'review_id': 285181425, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118} 2025-03-12 09:06:59 [reviews] INFO: Scraped item: {'review': 'Chicken was either stale or from last nights tandoori chicken', 'review_id': 285151395, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118} 2025-03-12 09:06:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18324118&page=1> {'review': 'Chicken was either stale or from last nights tandoori chicken', 'review_id': 285151395, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118} 2025-03-12 09:06:59 [reviews] INFO: Scraped item: {'review': '', 'review_id': 285118313, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118} 2025-03-12 09:06:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18324118&page=1> {'review': '', 'review_id': 285118313, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118} 2025-03-12 09:06:59 [reviews] INFO: Scraped item: {'review': '1, you get 6 pcs for 600
2. it is absolutely dry chicken saved by the cheese ', 'review_id': 284871210, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118} 2025-03-12 09:06:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18324118&page=1> {'review': '1, you get 6 pcs for 600
2. it is absolutely dry chicken saved by the cheese ', 'review_id': 284871210, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118} 2025-03-12 09:06:59 [reviews] INFO: Scraped item: {'review': "I told no til on Kulcha but here was til. The paneer sabji was bad and I took one bite and didn't touch it again. The soup was way too oily. save your money. there are better ones out there.", 'review_id': 284720662, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118} 2025-03-12 09:06:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18324118&page=1> {'review': "I told no til on Kulcha but here was til. The paneer sabji was bad and I took one bite and didn't touch it again. The soup was way too oily. save your money. there are better ones out there.", 'review_id': 284720662, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118} 2025-03-12 09:07:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:07:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:07:06 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Phoenix Marketcity (Kurla)', 'platform': 'zomato', 'res_id': 18326064, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770371, 'download_latency': 0.7288391590118408, 'depth': 0} 2025-03-12 09:07:06 [reviews] ERROR: Unrecognized relative_date format: 9 minutes ago 2025-03-12 09:07:06 [reviews] INFO: Stopping for res_id: 18326064 due to unrecognized date format: 9 minutes ago. 2025-03-12 09:07:09 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:07:13 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:07:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:07:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:07:21 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770387, 'download_latency': 0.7573821544647217, 'depth': 0} 2025-03-12 09:07:21 [reviews] INFO: Scraped item: {'review': 'food was pathetic ', 'review_id': 284919381, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461} 2025-03-12 09:07:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18349461&page=1> {'review': 'food was pathetic ', 'review_id': 284919381, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461} 2025-03-12 09:07:21 [reviews] INFO: Scraped item: {'review': 'undercooked Chicken..inedible food..how can your rice also be undercooked and chicken stale!', 'review_id': 284157920, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461} 2025-03-12 09:07:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18349461&page=1> {'review': 'undercooked Chicken..inedible food..how can your rice also be undercooked and chicken stale!', 'review_id': 284157920, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461} 2025-03-12 09:07:21 [reviews] INFO: Scraped item: {'review': "i had stones in my biryani 😐
a good quality basmati rice would never have stones
In fact I don't think this is basmati
just cheap long grain rice
ruined my biryani experience ", 'review_id': 284029302, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461} 2025-03-12 09:07:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18349461&page=1> {'review': "i had stones in my biryani 😐
a good quality basmati rice would never have stones
In fact I don't think this is basmati
just cheap long grain rice
ruined my biryani experience ", 'review_id': 284029302, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461} 2025-03-12 09:07:21 [reviews] INFO: Scraped item: {'review': 'The biryani was not worth and it was very dry', 'review_id': 283447214, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461} 2025-03-12 09:07:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18349461&page=1> {'review': 'The biryani was not worth and it was very dry', 'review_id': 283447214, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461} 2025-03-12 09:07:21 [reviews] INFO: Scraped item: {'review': 'bad service ', 'review_id': 283445535, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461} 2025-03-12 09:07:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18349461&page=1> {'review': 'bad service ', 'review_id': 283445535, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461} 2025-03-12 09:07:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:07:25 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18350121, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770391, 'download_latency': 0.8600430488586426, 'depth': 0} 2025-03-12 09:07:25 [reviews] INFO: Stopping for res_id: 18350121 as reviews are older than 7 days. 2025-03-12 09:07:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:07:28 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770395, 'download_latency': 0.7272908687591553, 'depth': 0} 2025-03-12 09:07:28 [reviews] INFO: Scraped item: {'review': '', 'review_id': 285206569, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082} 2025-03-12 09:07:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18363082&page=1> {'review': '', 'review_id': 285206569, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082} 2025-03-12 09:07:28 [reviews] INFO: Scraped item: {'review': 'no panner in paneer subj biryani and not even masala subji that usually is there', 'review_id': 284156989, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082} 2025-03-12 09:07:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18363082&page=1> {'review': 'no panner in paneer subj biryani and not even masala subji that usually is there', 'review_id': 284156989, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082} 2025-03-12 09:07:28 [reviews] INFO: Scraped item: {'review': 'How can you have your rolls filled with mayonnaise it was terrible', 'review_id': 283624129, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082} 2025-03-12 09:07:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18363082&page=1> {'review': 'How can you have your rolls filled with mayonnaise it was terrible', 'review_id': 283624129, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082} 2025-03-12 09:07:28 [reviews] INFO: Stopping for res_id: 18363082 as reviews are older than 7 days. 2025-03-12 09:07:31 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:07:35 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:07:39 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:07:43 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:07:47 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:07:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:07:51 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770414, 'download_latency': 0.6868395805358887, 'depth': 0} 2025-03-12 09:07:51 [reviews] INFO: Scraped item: {'review': 'nice service', 'review_id': 285169645, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184} 2025-03-12 09:07:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365184&page=1> {'review': 'nice service', 'review_id': 285169645, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184} 2025-03-12 09:07:51 [reviews] INFO: Scraped item: {'review': 'Clean and hygienic restaurant. Quick service. Their pav bhaaji is simply out of the box,delicious and mouth watering.Quality of food stands out.We went on a Saturday and it wasnt crowded.Will visit again for lunch/dinner.', 'review_id': 285071417, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184} 2025-03-12 09:07:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365184&page=1> {'review': 'Clean and hygienic restaurant. Quick service. Their pav bhaaji is simply out of the box,delicious and mouth watering.Quality of food stands out.We went on a Saturday and it wasnt crowded.Will visit again for lunch/dinner.', 'review_id': 285071417, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184} 2025-03-12 09:07:51 [reviews] INFO: Scraped item: {'review': 'excellent place to dine ', 'review_id': 284809889, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184} 2025-03-12 09:07:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365184&page=1> {'review': 'excellent place to dine ', 'review_id': 284809889, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184} 2025-03-12 09:07:51 [reviews] INFO: Scraped item: {'review': 'everything excellent 👌', 'review_id': 284508561, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184} 2025-03-12 09:07:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365184&page=1> {'review': 'everything excellent 👌', 'review_id': 284508561, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184} 2025-03-12 09:07:51 [reviews] INFO: Scraped item: {'review': 'Food was amazing. Nachos were not that really good, despite being offered for free.', 'review_id': 284493164, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184} 2025-03-12 09:07:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365184&page=1> {'review': 'Food was amazing. Nachos were not that really good, despite being offered for free.', 'review_id': 284493164, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184} 2025-03-12 09:07:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-12 09:07:57 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-12 09:07:57 [scrapy.extensions.logstats] INFO: Crawled 50 pages (at 6 pages/min), scraped 155 items (at 18 items/min) 2025-03-12 09:07:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:07:58 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18365355, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770419, 'download_latency': 0.81402587890625, 'depth': 0} 2025-03-12 09:07:58 [reviews] INFO: Scraped item: {'review': 'rice was soggy ', 'review_id': 283607491, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18365355} 2025-03-12 09:07:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365355&page=1> {'review': 'rice was soggy ', 'review_id': 283607491, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18365355} 2025-03-12 09:07:58 [reviews] INFO: Stopping for res_id: 18365355 as reviews are older than 7 days. 2025-03-12 09:08:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:08:04 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:08:09 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:08:13 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:08:17 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:08:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:08:23 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770441, 'download_latency': 1.6576757431030273, 'depth': 0} 2025-03-12 09:08:23 [reviews] INFO: Scraped item: {'review': 'poor qualityand quantity, i should have ordered from street side than this rolls, spoiling behroz name stick to biryani or improve roll quality', 'review_id': 285193468, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868} 2025-03-12 09:08:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365868&page=1> {'review': 'poor qualityand quantity, i should have ordered from street side than this rolls, spoiling behroz name stick to biryani or improve roll quality', 'review_id': 285193468, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868} 2025-03-12 09:08:23 [reviews] INFO: Scraped item: {'review': 'superb taste and excellent packing ', 'review_id': 284999801, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868} 2025-03-12 09:08:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365868&page=1> {'review': 'superb taste and excellent packing ', 'review_id': 284999801, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868} 2025-03-12 09:08:23 [reviews] INFO: Scraped item: {'review': 'Excellent packaging. Great taste and beautiful presentation', 'review_id': 284919802, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868} 2025-03-12 09:08:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365868&page=1> {'review': 'Excellent packaging. Great taste and beautiful presentation', 'review_id': 284919802, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868} 2025-03-12 09:08:23 [reviews] INFO: Scraped item: {'review': 'Delicious specially halwa', 'review_id': 284681926, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868} 2025-03-12 09:08:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365868&page=1> {'review': 'Delicious specially halwa', 'review_id': 284681926, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868} 2025-03-12 09:08:23 [reviews] INFO: Scraped item: {'review': 'Chicken not cooked properly also quality and quantity not OK this time.
Very disappointed and not expected from Behrouz. ', 'review_id': 284650736, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868} 2025-03-12 09:08:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365868&page=1> {'review': 'Chicken not cooked properly also quality and quantity not OK this time.
Very disappointed and not expected from Behrouz. ', 'review_id': 284650736, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868} 2025-03-12 09:08:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:08:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:08:29 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770449, 'download_latency': 0.7566242218017578, 'depth': 0} 2025-03-12 09:08:29 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284551632, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882} 2025-03-12 09:08:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365882&page=1> {'review': '', 'review_id': 284551632, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882} 2025-03-12 09:08:29 [reviews] INFO: Scraped item: {'review': 'aftaabi mushroom quantity was too little for this high price, taste also not good', 'review_id': 284150710, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882} 2025-03-12 09:08:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365882&page=1> {'review': 'aftaabi mushroom quantity was too little for this high price, taste also not good', 'review_id': 284150710, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882} 2025-03-12 09:08:29 [reviews] INFO: Scraped item: {'review': 'Very oily and spicy fell sick after consuming the biryani', 'review_id': 283839451, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882} 2025-03-12 09:08:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365882&page=1> {'review': 'Very oily and spicy fell sick after consuming the biryani', 'review_id': 283839451, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882} 2025-03-12 09:08:29 [reviews] INFO: Scraped item: {'review': 'I was not provided with lemon soda in the order. I have been charged for the same ... And nether delivery partner was taking responsibility nor the restaurant!', 'review_id': 283815662, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882} 2025-03-12 09:08:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365882&page=1> {'review': 'I was not provided with lemon soda in the order. I have been charged for the same ... And nether delivery partner was taking responsibility nor the restaurant!', 'review_id': 283815662, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882} 2025-03-12 09:08:29 [reviews] INFO: Scraped item: {'review': 'worst biriyani ', 'review_id': 283586576, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882} 2025-03-12 09:08:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365882&page=1> {'review': 'worst biriyani ', 'review_id': 283586576, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882} 2025-03-12 09:08:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:08:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:08:41 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:08:45 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:08:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:08:50 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770467, 'download_latency': 0.7703092098236084, 'depth': 0} 2025-03-12 09:08:50 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284607805, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897} 2025-03-12 09:08:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365897&page=1> {'review': '', 'review_id': 284607805, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897} 2025-03-12 09:08:50 [reviews] INFO: Scraped item: {'review': 'what a shame
what a scam
pathetic food
micro quantity
tasteless items
supremely disappointed ', 'review_id': 284494240, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897} 2025-03-12 09:08:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365897&page=1> {'review': 'what a shame
what a scam
pathetic food
micro quantity
tasteless items
supremely disappointed ', 'review_id': 284494240, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897} 2025-03-12 09:08:50 [reviews] INFO: Scraped item: {'review': 'Delicious meals perfect for every family. The paneer lababdaar was super tasty. The chicken dish was well cooked and not too spicy and oily, just right. And we regret ordering only 100gm gajar halwa because it was also so tasty. ', 'review_id': 284287327, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897} 2025-03-12 09:08:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365897&page=1> {'review': 'Delicious meals perfect for every family. The paneer lababdaar was super tasty. The chicken dish was well cooked and not too spicy and oily, just right. And we regret ordering only 100gm gajar halwa because it was also so tasty. ', 'review_id': 284287327, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897} 2025-03-12 09:08:50 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284245776, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897} 2025-03-12 09:08:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365897&page=1> {'review': '', 'review_id': 284245776, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897} 2025-03-12 09:08:50 [reviews] INFO: Scraped item: {'review': 'it was not good as it used to be', 'review_id': 283902292, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897} 2025-03-12 09:08:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365897&page=1> {'review': 'it was not good as it used to be', 'review_id': 283902292, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897} 2025-03-12 09:08:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:08:52 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18365991, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770471, 'download_latency': 0.7704288959503174, 'depth': 0} 2025-03-12 09:08:52 [reviews] ERROR: Error parsing date: an hour ago, error: unsupported type for timedelta hours component: NoneType 2025-03-12 09:08:52 [reviews] INFO: Stopping for res_id: 18365991 due to unrecognized date format: an hour ago. 2025-03-12 09:08:55 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-12 09:08:57 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-12 09:08:57 [scrapy.extensions.logstats] INFO: Crawled 55 pages (at 5 pages/min), scraped 171 items (at 16 items/min) 2025-03-12 09:08:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:09:03 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:09:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:09:10 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:09:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:09:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:09:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:09:21 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18368221, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770503, 'download_latency': 0.7677481174468994, 'depth': 0} 2025-03-12 09:09:21 [reviews] INFO: Scraped item: {'review': 'this is a very bad experience I received the delivery very late as the food became cold now ', 'review_id': 283906761, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18368221} 2025-03-12 09:09:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18368221&page=1> {'review': 'this is a very bad experience I received the delivery very late as the food became cold now ', 'review_id': 283906761, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18368221} 2025-03-12 09:09:21 [reviews] INFO: Scraped item: {'review': 'Too much oil', 'review_id': 283719965, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18368221} 2025-03-12 09:09:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18368221&page=1> {'review': 'Too much oil', 'review_id': 283719965, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18368221} 2025-03-12 09:09:21 [reviews] INFO: Scraped item: {'review': 'The metal handi is a nice touch. But it would be great if you could take it back for reusing. ', 'review_id': 283650701, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18368221} 2025-03-12 09:09:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18368221&page=1> {'review': 'The metal handi is a nice touch. But it would be great if you could take it back for reusing. ', 'review_id': 283650701, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18368221} 2025-03-12 09:09:21 [reviews] INFO: Stopping for res_id: 18368221 as reviews are older than 7 days. 2025-03-12 09:09:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:09:29 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:09:33 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:09:37 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:09:40 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:09:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:09:45 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770526, 'download_latency': 0.793708086013794, 'depth': 0} 2025-03-12 09:09:45 [reviews] INFO: Scraped item: {'review': 'Chicken tikka Roll was not even hot. It was cold. Not expected from the outlet', 'review_id': 285083845, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009} 2025-03-12 09:09:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372009&page=1> {'review': 'Chicken tikka Roll was not even hot. It was cold. Not expected from the outlet', 'review_id': 285083845, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009} 2025-03-12 09:09:45 [reviews] INFO: Scraped item: {'review': 'biryani was too salty ', 'review_id': 284578750, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009} 2025-03-12 09:09:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372009&page=1> {'review': 'biryani was too salty ', 'review_id': 284578750, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009} 2025-03-12 09:09:45 [reviews] INFO: Scraped item: {'review': 'Very less chicken pieces and biryani expensive for the price and what is offered', 'review_id': 284480805, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009} 2025-03-12 09:09:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372009&page=1> {'review': 'Very less chicken pieces and biryani expensive for the price and what is offered', 'review_id': 284480805, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009} 2025-03-12 09:09:45 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283938377, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009} 2025-03-12 09:09:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372009&page=1> {'review': '', 'review_id': 283938377, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009} 2025-03-12 09:09:45 [reviews] INFO: Scraped item: {'review': 'food was good specially haleem. the kebab could have been a bit soft', 'review_id': 283878572, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009} 2025-03-12 09:09:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372009&page=1> {'review': 'food was good specially haleem. the kebab could have been a bit soft', 'review_id': 283878572, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009} 2025-03-12 09:09:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:09:48 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770530, 'download_latency': 0.7358825206756592, 'depth': 0} 2025-03-12 09:09:48 [reviews] INFO: Scraped item: {'review': 'Wrong product sent....ordered mungdal Halwa and received Gajar ka Halwa', 'review_id': 285207602, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044} 2025-03-12 09:09:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372044&page=1> {'review': 'Wrong product sent....ordered mungdal Halwa and received Gajar ka Halwa', 'review_id': 285207602, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044} 2025-03-12 09:09:48 [reviews] INFO: Scraped item: {'review': 'it was mind-blowing. will definitely order again ', 'review_id': 284459408, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044} 2025-03-12 09:09:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372044&page=1> {'review': 'it was mind-blowing. will definitely order again ', 'review_id': 284459408, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044} 2025-03-12 09:09:48 [reviews] INFO: Scraped item: {'review': 'Taste was not good-.. Specially Paneer-..', 'review_id': 284336540, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044} 2025-03-12 09:09:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372044&page=1> {'review': 'Taste was not good-.. Specially Paneer-..', 'review_id': 284336540, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044} 2025-03-12 09:09:48 [reviews] INFO: Scraped item: {'review': 'as expected very tasty ', 'review_id': 284327876, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044} 2025-03-12 09:09:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372044&page=1> {'review': 'as expected very tasty ', 'review_id': 284327876, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044} 2025-03-12 09:09:48 [reviews] INFO: Scraped item: {'review': "worst biryani and panner ever had even the zomato guys don't respond not the hotel members to hear my issue..the worst biryani don't order", 'review_id': 283767489, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044} 2025-03-12 09:09:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372044&page=1> {'review': "worst biryani and panner ever had even the zomato guys don't respond not the hotel members to hear my issue..the worst biryani don't order", 'review_id': 283767489, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044} 2025-03-12 09:09:52 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:09:56 [scrapy.extensions.logstats] INFO: Crawled 58 pages (at 3 pages/min), scraped 184 items (at 13 items/min) 2025-03-12 09:09:56 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:10:01 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:10:04 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:10:08 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:10:12 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:10:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:10:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:10:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:10:26 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770561, 'download_latency': 1.8425579071044922, 'depth': 0} 2025-03-12 09:10:26 [reviews] INFO: Scraped item: {'review': 'malai tikka was burnt and tasted bitter', 'review_id': 285071743, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663} 2025-03-12 09:10:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18381663&page=1> {'review': 'malai tikka was burnt and tasted bitter', 'review_id': 285071743, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663} 2025-03-12 09:10:26 [reviews] INFO: Scraped item: {'review': 'ordered paneer tikka but wrong order sent. they sent hariyali kabab :(', 'review_id': 284066891, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663} 2025-03-12 09:10:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18381663&page=1> {'review': 'ordered paneer tikka but wrong order sent. they sent hariyali kabab :(', 'review_id': 284066891, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663} 2025-03-12 09:10:26 [reviews] INFO: Scraped item: {'review': 'no salt', 'review_id': 284039745, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663} 2025-03-12 09:10:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18381663&page=1> {'review': 'no salt', 'review_id': 284039745, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663} 2025-03-12 09:10:26 [reviews] INFO: Scraped item: {'review': 'Waste of money dis', 'review_id': 283380145, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663} 2025-03-12 09:10:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18381663&page=1> {'review': 'Waste of money dis', 'review_id': 283380145, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663} 2025-03-12 09:10:26 [reviews] INFO: Stopping for res_id: 18381663 as reviews are older than 7 days. 2025-03-12 09:10:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:10:31 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:10:34 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:10:38 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:10:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:10:41 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 56, 'brand_name': 'Noshi - Yum Asian Delivery', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18382342, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770581, 'download_latency': 0.8462483882904053, 'depth': 0} 2025-03-12 09:10:41 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284810283, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 56, 'brand_name': 'Noshi - Yum Asian Delivery', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18382342} 2025-03-12 09:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18382342&page=1> {'review': '', 'review_id': 284810283, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 56, 'brand_name': 'Noshi - Yum Asian Delivery', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18382342} 2025-03-12 09:10:41 [reviews] INFO: Stopping for res_id: 18382342 as reviews are older than 7 days. 2025-03-12 09:10:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:10:45 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770585, 'download_latency': 1.3089640140533447, 'depth': 0} 2025-03-12 09:10:45 [reviews] INFO: Scraped item: {'review': 'Salt was high', 'review_id': 285074536, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182} 2025-03-12 09:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18440182&page=1> {'review': 'Salt was high', 'review_id': 285074536, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182} 2025-03-12 09:10:45 [reviews] INFO: Scraped item: {'review': 'BBK used to be good, but not anymore. Biryani is extremely dry (needs ghee) and the spice is way too overpowering. Cheap quality eggs used, mutton pieces too small and boney.', 'review_id': 284846856, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182} 2025-03-12 09:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18440182&page=1> {'review': 'BBK used to be good, but not anymore. Biryani is extremely dry (needs ghee) and the spice is way too overpowering. Cheap quality eggs used, mutton pieces too small and boney.', 'review_id': 284846856, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182} 2025-03-12 09:10:45 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284523302, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182} 2025-03-12 09:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18440182&page=1> {'review': '', 'review_id': 284523302, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182} 2025-03-12 09:10:45 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284487869, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182} 2025-03-12 09:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18440182&page=1> {'review': '', 'review_id': 284487869, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182} 2025-03-12 09:10:45 [reviews] INFO: Scraped item: {'review': 'bad packaging ', 'review_id': 284423917, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182} 2025-03-12 09:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18440182&page=1> {'review': 'bad packaging ', 'review_id': 284423917, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182} 2025-03-12 09:10:47 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:10:51 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:10:55 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:10:56 [scrapy.extensions.logstats] INFO: Crawled 61 pages (at 3 pages/min), scraped 194 items (at 10 items/min) 2025-03-12 09:10:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:11:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:11:03 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:11:06 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:11:10 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:11:13 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:11:17 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:11:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:11:23 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:11:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:11:31 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:11:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:11:35 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770641, 'download_latency': 1.2817237377166748, 'depth': 0} 2025-03-12 09:11:35 [reviews] INFO: Scraped item: {'review': "had before but this time quality wasn't that good of briyani for which they are known for.", 'review_id': 285198976, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435} 2025-03-12 09:11:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18466435&page=1> {'review': "had before but this time quality wasn't that good of briyani for which they are known for.", 'review_id': 285198976, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435} 2025-03-12 09:11:35 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284965414, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435} 2025-03-12 09:11:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18466435&page=1> {'review': '', 'review_id': 284965414, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435} 2025-03-12 09:11:35 [reviews] INFO: Scraped item: {'review': 'there were only two pieces of chicken, biryani was almost at cold state .', 'review_id': 284615944, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435} 2025-03-12 09:11:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18466435&page=1> {'review': 'there were only two pieces of chicken, biryani was almost at cold state .', 'review_id': 284615944, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435} 2025-03-12 09:11:35 [reviews] INFO: Scraped item: {'review': 'Express delivery with awesome taste 😉', 'review_id': 284600040, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435} 2025-03-12 09:11:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18466435&page=1> {'review': 'Express delivery with awesome taste 😉', 'review_id': 284600040, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435} 2025-03-12 09:11:35 [reviews] INFO: Scraped item: {'review': 'really bad biryani.
gulam jamun were rock hard.', 'review_id': 284348559, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435} 2025-03-12 09:11:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18466435&page=1> {'review': 'really bad biryani.
gulam jamun were rock hard.', 'review_id': 284348559, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435} 2025-03-12 09:11:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:11:39 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770645, 'download_latency': 1.0904247760772705, 'depth': 0} 2025-03-12 09:11:39 [reviews] INFO: Scraped item: {'review': '', 'review_id': 285142957, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370} 2025-03-12 09:11:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18535370&page=1> {'review': '', 'review_id': 285142957, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370} 2025-03-12 09:11:39 [reviews] INFO: Scraped item: {'review': 'Good taste . Loved it.', 'review_id': 285082613, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370} 2025-03-12 09:11:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18535370&page=1> {'review': 'Good taste . Loved it.', 'review_id': 285082613, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370} 2025-03-12 09:11:39 [reviews] INFO: Scraped item: {'review': 'Food is extremely good . Chicken is excellent', 'review_id': 285062837, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370} 2025-03-12 09:11:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18535370&page=1> {'review': 'Food is extremely good . Chicken is excellent', 'review_id': 285062837, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370} 2025-03-12 09:11:39 [reviews] INFO: Scraped item: {'review': 'taste less ', 'review_id': 284917279, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370} 2025-03-12 09:11:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18535370&page=1> {'review': 'taste less ', 'review_id': 284917279, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370} 2025-03-12 09:11:39 [reviews] INFO: Scraped item: {'review': 'the restaurant took too much time preparing the meal.', 'review_id': 284763775, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370} 2025-03-12 09:11:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18535370&page=1> {'review': 'the restaurant took too much time preparing the meal.', 'review_id': 284763775, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370} 2025-03-12 09:11:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:11:43 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:11:47 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:11:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:11:53 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:11:56 [scrapy.extensions.logstats] INFO: Crawled 63 pages (at 2 pages/min), scraped 204 items (at 10 items/min) 2025-03-12 09:11:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:12:01 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:12:05 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:12:08 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:12:11 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:12:15 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:12:19 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:12:23 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:12:28 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:12:32 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:12:35 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:12:39 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:12:43 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:12:45 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:12:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:12:53 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:12:56 [scrapy.extensions.logstats] INFO: Crawled 63 pages (at 0 pages/min), scraped 204 items (at 0 items/min) 2025-03-12 09:12:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:13:01 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:13:03 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:13:08 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:13:08 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 55, 'brand_name': 'Enoki - Fresh Asian Kitchen', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18537577, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770728, 'download_latency': 1.6781413555145264, 'depth': 0} 2025-03-12 09:13:08 [reviews] ERROR: Unrecognized relative_date format: 41 minutes ago 2025-03-12 09:13:08 [reviews] INFO: Stopping for res_id: 18537577 due to unrecognized date format: 41 minutes ago. 2025-03-12 09:13:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:13:11 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 53, 'brand_name': 'Yum Yum Cha', 'city': 'New Delhi', 'sub_zone': 'Khan Market', 'platform': 'zomato', 'res_id': 18544058, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770732, 'download_latency': 0.7323195934295654, 'depth': 0} 2025-03-12 09:13:11 [reviews] INFO: Stopping for res_id: 18544058 as reviews are older than 7 days. 2025-03-12 09:13:13 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:13:17 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:13:21 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:13:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:13:24 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770748, 'download_latency': 0.6954586505889893, 'depth': 0} 2025-03-12 09:13:24 [reviews] INFO: Scraped item: {'review': 'The taste was really good but the quantity was too less', 'review_id': 284920702, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628} 2025-03-12 09:13:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18547628&page=1> {'review': 'The taste was really good but the quantity was too less', 'review_id': 284920702, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628} 2025-03-12 09:13:24 [reviews] INFO: Scraped item: {'review': 'food quality and quantity was deplorable ', 'review_id': 284862253, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628} 2025-03-12 09:13:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18547628&page=1> {'review': 'food quality and quantity was deplorable ', 'review_id': 284862253, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628} 2025-03-12 09:13:24 [reviews] INFO: Scraped item: {'review': 'Biryani was very bad', 'review_id': 284655881, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628} 2025-03-12 09:13:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18547628&page=1> {'review': 'Biryani was very bad', 'review_id': 284655881, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628} 2025-03-12 09:13:24 [reviews] INFO: Scraped item: {'review': 'taste was not soo good , strong fragrance of cinnamon powder ', 'review_id': 284169377, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628} 2025-03-12 09:13:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18547628&page=1> {'review': 'taste was not soo good , strong fragrance of cinnamon powder ', 'review_id': 284169377, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628} 2025-03-12 09:13:24 [reviews] INFO: Scraped item: {'review': 'just like normal rice', 'review_id': 283821355, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628} 2025-03-12 09:13:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18547628&page=1> {'review': 'just like normal rice', 'review_id': 283821355, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628} 2025-03-12 09:13:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:13:28 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770752, 'download_latency': 0.7261312007904053, 'depth': 0} 2025-03-12 09:13:28 [reviews] INFO: Scraped item: {'review': 'So I’ve been a very regural customer here and always have been taken care by the manager and staff. Special thanks to Shyam bhai for giving Michelin star service !
Today I ate newly launched krapow bowl suggested by pinku bhai (manager ) which was really tasty and healthy.
Thankyou pinku bhai and team', 'review_id': 284869767, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415} 2025-03-12 09:13:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18575415&page=1> {'review': 'So I’ve been a very regural customer here and always have been taken care by the manager and staff. Special thanks to Shyam bhai for giving Michelin star service !
Today I ate newly launched krapow bowl suggested by pinku bhai (manager ) which was really tasty and healthy.
Thankyou pinku bhai and team', 'review_id': 284869767, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415} 2025-03-12 09:13:28 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284551174, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415} 2025-03-12 09:13:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18575415&page=1> {'review': '', 'review_id': 284551174, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415} 2025-03-12 09:13:28 [reviews] INFO: Scraped item: {'review': 'Nice test 👌 ', 'review_id': 283603408, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415} 2025-03-12 09:13:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18575415&page=1> {'review': 'Nice test 👌 ', 'review_id': 283603408, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415} 2025-03-12 09:13:28 [reviews] INFO: Stopping for res_id: 18575415 as reviews are older than 7 days. 2025-03-12 09:13:30 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:13:34 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:13:38 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:13:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:13:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:13:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:13:52 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:13:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:13:56 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770781, 'download_latency': 0.707573413848877, 'depth': 0} 2025-03-12 09:13:56 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284828353, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108} 2025-03-12 09:13:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18577108&page=1> {'review': '', 'review_id': 284828353, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108} 2025-03-12 09:13:56 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284501145, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108} 2025-03-12 09:13:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18577108&page=1> {'review': '', 'review_id': 284501145, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108} 2025-03-12 09:13:56 [reviews] INFO: Scraped item: {'review': 'The duck was cooked very well and paired very well with the sauces. The dimsums and sushi was made very well and the choice of sauces with all the food was excellent.
Swapan our server was extremely helpful and proved great at suggestions for the food, thank you!', 'review_id': 283730811, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108} 2025-03-12 09:13:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18577108&page=1> {'review': 'The duck was cooked very well and paired very well with the sauces. The dimsums and sushi was made very well and the choice of sauces with all the food was excellent.
Swapan our server was extremely helpful and proved great at suggestions for the food, thank you!', 'review_id': 283730811, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108} 2025-03-12 09:13:56 [reviews] INFO: Stopping for res_id: 18577108 as reviews are older than 7 days. 2025-03-12 09:13:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-12 09:13:57 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-12 09:13:57 [scrapy.extensions.logstats] INFO: Crawled 68 pages (at 5 pages/min), scraped 215 items (at 11 items/min) 2025-03-12 09:13:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:14:00 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770783, 'download_latency': 0.7122933864593506, 'depth': 0} 2025-03-12 09:14:00 [reviews] INFO: Scraped item: {'review': 'Amazing', 'review_id': 284795336, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428} 2025-03-12 09:14:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582428&page=1> {'review': 'Amazing', 'review_id': 284795336, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428} 2025-03-12 09:14:00 [reviews] INFO: Scraped item: {'review': 'Absolutely flavourless', 'review_id': 283808692, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428} 2025-03-12 09:14:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582428&page=1> {'review': 'Absolutely flavourless', 'review_id': 283808692, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428} 2025-03-12 09:14:00 [reviews] INFO: Scraped item: {'review': 'Too good', 'review_id': 283774200, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428} 2025-03-12 09:14:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582428&page=1> {'review': 'Too good', 'review_id': 283774200, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428} 2025-03-12 09:14:00 [reviews] INFO: Scraped item: {'review': 'Biryani was burnt, it tasted so bitter, had to throw away all the food', 'review_id': 283317881, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428} 2025-03-12 09:14:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582428&page=1> {'review': 'Biryani was burnt, it tasted so bitter, had to throw away all the food', 'review_id': 283317881, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428} 2025-03-12 09:14:00 [reviews] INFO: Scraped item: {'review': 'Awesome Biryani Loved it...!!', 'review_id': 283235823, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428} 2025-03-12 09:14:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582428&page=1> {'review': 'Awesome Biryani Loved it...!!', 'review_id': 283235823, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428} 2025-03-12 09:14:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:14:03 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770789, 'download_latency': 0.7485396862030029, 'depth': 0} 2025-03-12 09:14:03 [reviews] INFO: Scraped item: {'review': "Very bad taste..it doesn't looked like biryaani", 'review_id': 284944236, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431} 2025-03-12 09:14:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582431&page=1> {'review': "Very bad taste..it doesn't looked like biryaani", 'review_id': 284944236, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431} 2025-03-12 09:14:03 [reviews] INFO: Scraped item: {'review': 'Very tasty ...Thanks', 'review_id': 284832542, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431} 2025-03-12 09:14:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582431&page=1> {'review': 'Very tasty ...Thanks', 'review_id': 284832542, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431} 2025-03-12 09:14:03 [reviews] INFO: Scraped item: {'review': 'I think chicken quantity is less', 'review_id': 284819023, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431} 2025-03-12 09:14:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582431&page=1> {'review': 'I think chicken quantity is less', 'review_id': 284819023, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431} 2025-03-12 09:14:03 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284455444, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431} 2025-03-12 09:14:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582431&page=1> {'review': '', 'review_id': 284455444, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431} 2025-03-12 09:14:03 [reviews] INFO: Scraped item: {'review': "I didn't received my gajar ka halwa", 'review_id': 284272445, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431} 2025-03-12 09:14:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582431&page=1> {'review': "I didn't received my gajar ka halwa", 'review_id': 284272445, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431} 2025-03-12 09:14:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:14:05 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 0, 'brand_name': 'La Veggie', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 18628825, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770791, 'download_latency': 0.7388060092926025, 'depth': 0} 2025-03-12 09:14:05 [reviews] INFO: Scraped item: {'review': 'Good food', 'review_id': 284944622, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 0, 'brand_name': 'La Veggie', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 18628825} 2025-03-12 09:14:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18628825&page=1> {'review': 'Good food', 'review_id': 284944622, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 0, 'brand_name': 'La Veggie', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 18628825} 2025-03-12 09:14:05 [reviews] INFO: Scraped item: {'review': 'Family dine in place loved the vibe food and staff is very nice
North indian is best', 'review_id': 284815332, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 0, 'brand_name': 'La Veggie', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 18628825} 2025-03-12 09:14:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18628825&page=1> {'review': 'Family dine in place loved the vibe food and staff is very nice
North indian is best', 'review_id': 284815332, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 0, 'brand_name': 'La Veggie', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 18628825} 2025-03-12 09:14:05 [reviews] INFO: Scraped item: {'review': 'This is a family restaurant near Chowpatty.
Appropriate for large guests as well, i have been twice with my entire family of 12-15 people.

The staff was always attentive to the table and was quick. The food was great taste and a wide jain menu is available. If you are not comfortable with spicy food please do mention to the staff to make the food less spicy.

They have good food for the pricing.
The laska soup is coconut based soup and very nice.
In starters we really enjoyed the jain crispy vegetables and cheese marbles.

They have valet parking available too.', 'review_id': 284608676, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 0, 'brand_name': 'La Veggie', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 18628825} 2025-03-12 09:14:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18628825&page=1> {'review': 'This is a family restaurant near Chowpatty.
Appropriate for large guests as well, i have been twice with my entire family of 12-15 people.

The staff was always attentive to the table and was quick. The food was great taste and a wide jain menu is available. If you are not comfortable with spicy food please do mention to the staff to make the food less spicy.

They have good food for the pricing.
The laska soup is coconut based soup and very nice.
In starters we really enjoyed the jain crispy vegetables and cheese marbles.

They have valet parking available too.', 'review_id': 284608676, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 0, 'brand_name': 'La Veggie', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 18628825} 2025-03-12 09:14:05 [reviews] INFO: Stopping for res_id: 18628825 as reviews are older than 7 days. 2025-03-12 09:14:08 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:14:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:14:12 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Defence Colony', 'platform': 'zomato', 'res_id': 18632303, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770797, 'download_latency': 0.7780659198760986, 'depth': 0} 2025-03-12 09:14:12 [reviews] INFO: Scraped item: {'review': 'worst food, worst taste , thrown all food not eatable ', 'review_id': 284930380, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Defence Colony', 'platform': 'zomato', 'res_id': 18632303} 2025-03-12 09:14:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18632303&page=1> {'review': 'worst food, worst taste , thrown all food not eatable ', 'review_id': 284930380, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Defence Colony', 'platform': 'zomato', 'res_id': 18632303} 2025-03-12 09:14:12 [reviews] INFO: Stopping for res_id: 18632303 as reviews are older than 7 days. 2025-03-12 09:14:15 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:14:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:14:20 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 49, 'brand_name': 'Pa Pa Ya', 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18650200, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770805, 'download_latency': 0.8136677742004395, 'depth': 0} 2025-03-12 09:14:20 [reviews] INFO: Scraped item: {'review': 'Worst taste ever', 'review_id': 285269982, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-12', 'competitor_id': 49, 'brand_name': 'Pa Pa Ya', 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18650200} 2025-03-12 09:14:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18650200&page=1> {'review': 'Worst taste ever', 'review_id': 285269982, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-12', 'competitor_id': 49, 'brand_name': 'Pa Pa Ya', 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18650200} 2025-03-12 09:14:20 [reviews] INFO: Scraped item: {'review': 'Nasi goreng was supposed to be less spicy as mentioned in the cooking instructions', 'review_id': 284054753, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 49, 'brand_name': 'Pa Pa Ya', 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18650200} 2025-03-12 09:14:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18650200&page=1> {'review': 'Nasi goreng was supposed to be less spicy as mentioned in the cooking instructions', 'review_id': 284054753, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 49, 'brand_name': 'Pa Pa Ya', 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18650200} 2025-03-12 09:14:20 [reviews] INFO: Scraped item: {'review': 'Simply breathtaking views. beautiful ambience, polite staff and out of the world experience with food ! ', 'review_id': 283976824, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 49, 'brand_name': 'Pa Pa Ya', 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18650200} 2025-03-12 09:14:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18650200&page=1> {'review': 'Simply breathtaking views. beautiful ambience, polite staff and out of the world experience with food ! ', 'review_id': 283976824, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 49, 'brand_name': 'Pa Pa Ya', 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18650200} 2025-03-12 09:14:20 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283252611, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 49, 'brand_name': 'Pa Pa Ya', 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18650200} 2025-03-12 09:14:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18650200&page=1> {'review': '', 'review_id': 283252611, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 49, 'brand_name': 'Pa Pa Ya', 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18650200} 2025-03-12 09:14:20 [reviews] INFO: Scraped item: {'review': 'Spectacular food, great service with a great view!', 'review_id': 283233385, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-06', 'competitor_id': 49, 'brand_name': 'Pa Pa Ya', 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18650200} 2025-03-12 09:14:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18650200&page=1> {'review': 'Spectacular food, great service with a great view!', 'review_id': 283233385, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-06', 'competitor_id': 49, 'brand_name': 'Pa Pa Ya', 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18650200} 2025-03-12 09:14:23 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:14:26 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:14:30 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:14:34 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:14:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:14:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:14:45 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:14:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:14:49 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770833, 'download_latency': 0.751502275466919, 'depth': 0} 2025-03-12 09:14:49 [reviews] INFO: Scraped item: {'review': 'It was wonderful experience dining here. The ambience is calm and unique. The service was great. Special cheers to Avni for being a great host. Much Recommended.', 'review_id': 285045891, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316} 2025-03-12 09:14:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18658316&page=1> {'review': 'It was wonderful experience dining here. The ambience is calm and unique. The service was great. Special cheers to Avni for being a great host. Much Recommended.', 'review_id': 285045891, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316} 2025-03-12 09:14:49 [reviews] INFO: Scraped item: {'review': 'order delayed by 2 hrs. taste was not good. raita was hot ', 'review_id': 285004671, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316} 2025-03-12 09:14:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18658316&page=1> {'review': 'order delayed by 2 hrs. taste was not good. raita was hot ', 'review_id': 285004671, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316} 2025-03-12 09:14:49 [reviews] INFO: Scraped item: {'review': 'Mohit bisht ', 'review_id': 284744766, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316} 2025-03-12 09:14:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18658316&page=1> {'review': 'Mohit bisht ', 'review_id': 284744766, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316} 2025-03-12 09:14:49 [reviews] INFO: Scraped item: {'review': 'Package was leaking... all the curd had leaked already. Taste also not great!', 'review_id': 284742564, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316} 2025-03-12 09:14:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18658316&page=1> {'review': 'Package was leaking... all the curd had leaked already. Taste also not great!', 'review_id': 284742564, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316} 2025-03-12 09:14:49 [reviews] INFO: Scraped item: {'review': 'decent enough taste, but the tandoori chicken was a bit dry and hard', 'review_id': 284461700, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316} 2025-03-12 09:14:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18658316&page=1> {'review': 'decent enough taste, but the tandoori chicken was a bit dry and hard', 'review_id': 284461700, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316} 2025-03-12 09:14:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:14:52 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770836, 'download_latency': 0.7519931793212891, 'depth': 0} 2025-03-12 09:14:52 [reviews] INFO: Scraped item: {'review': 'Too oily. Taste is okay.', 'review_id': 285197821, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842} 2025-03-12 09:14:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18665842&page=1> {'review': 'Too oily. Taste is okay.', 'review_id': 285197821, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842} 2025-03-12 09:14:52 [reviews] INFO: Scraped item: {'review': 'Worst food i take in my life ..dont order from here', 'review_id': 285100469, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842} 2025-03-12 09:14:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18665842&page=1> {'review': 'Worst food i take in my life ..dont order from here', 'review_id': 285100469, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842} 2025-03-12 09:14:52 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284618914, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842} 2025-03-12 09:14:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18665842&page=1> {'review': '', 'review_id': 284618914, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842} 2025-03-12 09:14:52 [reviews] INFO: Scraped item: {'review': 'chiken biryani test was not good', 'review_id': 284400352, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842} 2025-03-12 09:14:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18665842&page=1> {'review': 'chiken biryani test was not good', 'review_id': 284400352, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842} 2025-03-12 09:14:52 [reviews] INFO: Scraped item: {'review': 'Very tasty and spicy ', 'review_id': 283618707, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842} 2025-03-12 09:14:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18665842&page=1> {'review': 'Very tasty and spicy ', 'review_id': 283618707, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842} 2025-03-12 09:14:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:14:56 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18669449, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770840, 'download_latency': 0.8026671409606934, 'depth': 0} 2025-03-12 09:14:56 [reviews] INFO: Scraped item: {'review': 'Not Good', 'review_id': 284389236, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18669449} 2025-03-12 09:14:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18669449&page=1> {'review': 'Not Good', 'review_id': 284389236, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18669449} 2025-03-12 09:14:56 [reviews] INFO: Scraped item: {'review': 'too little quantity, rice not in proportion with gravy, too spicy. not value for money at all', 'review_id': 284353974, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18669449} 2025-03-12 09:14:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18669449&page=1> {'review': 'too little quantity, rice not in proportion with gravy, too spicy. not value for money at all', 'review_id': 284353974, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18669449} 2025-03-12 09:14:56 [reviews] INFO: Scraped item: {'review': 'it was very bland and was saltless..we did not expected this frm behrouz', 'review_id': 284168454, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18669449} 2025-03-12 09:14:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18669449&page=1> {'review': 'it was very bland and was saltless..we did not expected this frm behrouz', 'review_id': 284168454, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18669449} 2025-03-12 09:14:56 [reviews] INFO: Scraped item: {'review': 'Haleem was not authentic', 'review_id': 283734123, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18669449} 2025-03-12 09:14:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18669449&page=1> {'review': 'Haleem was not authentic', 'review_id': 283734123, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18669449} 2025-03-12 09:14:56 [reviews] INFO: Stopping for res_id: 18669449 as reviews are older than 7 days. 2025-03-12 09:14:56 [scrapy.extensions.logstats] INFO: Crawled 76 pages (at 8 pages/min), scraped 248 items (at 33 items/min) 2025-03-12 09:14:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:15:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:15:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:15:05 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770848, 'download_latency': 0.7178459167480469, 'depth': 0} 2025-03-12 09:15:05 [reviews] INFO: Scraped item: {'review': "The Chicken Mayo Roll was a punishment to eat. Overly sweet Mayo (It's not a real Mayo); No evidence that there was any chicken; the bun was a pain to eat, with a strange shape and a hard base. Lastly but not the least, for some strange reason there was one piece of corn, not sure why. Overall a pathetic experience to eat that roll. Spoilt my mood, appetite and desire to eat a roll ever again.

Rumali roti was good!", 'review_id': 285168184, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791} 2025-03-12 09:15:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18670791&page=1> {'review': "The Chicken Mayo Roll was a punishment to eat. Overly sweet Mayo (It's not a real Mayo); No evidence that there was any chicken; the bun was a pain to eat, with a strange shape and a hard base. Lastly but not the least, for some strange reason there was one piece of corn, not sure why. Overall a pathetic experience to eat that roll. Spoilt my mood, appetite and desire to eat a roll ever again.

Rumali roti was good!", 'review_id': 285168184, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791} 2025-03-12 09:15:05 [reviews] INFO: Scraped item: {'review': 'good service ', 'review_id': 285028184, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791} 2025-03-12 09:15:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18670791&page=1> {'review': 'good service ', 'review_id': 285028184, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791} 2025-03-12 09:15:05 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284773146, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791} 2025-03-12 09:15:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18670791&page=1> {'review': '', 'review_id': 284773146, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791} 2025-03-12 09:15:05 [reviews] INFO: Scraped item: {'review': 'overall good, biryani pe thoda dhyan de', 'review_id': 284753067, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791} 2025-03-12 09:15:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18670791&page=1> {'review': 'overall good, biryani pe thoda dhyan de', 'review_id': 284753067, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791} 2025-03-12 09:15:05 [reviews] INFO: Scraped item: {'review': 'You charge so high for the peices of bones in Nihari? Rubbish never will order again. ', 'review_id': 284196878, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791} 2025-03-12 09:15:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18670791&page=1> {'review': 'You charge so high for the peices of bones in Nihari? Rubbish never will order again. ', 'review_id': 284196878, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791} 2025-03-12 09:15:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:15:11 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770853, 'download_latency': 1.7788915634155273, 'depth': 0} 2025-03-12 09:15:11 [reviews] INFO: Scraped item: {'review': 'rice quantity very less ', 'review_id': 284599855, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928} 2025-03-12 09:15:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18687928&page=1> {'review': 'rice quantity very less ', 'review_id': 284599855, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928} 2025-03-12 09:15:11 [reviews] INFO: Scraped item: {'review': 'Wrost service', 'review_id': 284156655, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928} 2025-03-12 09:15:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18687928&page=1> {'review': 'Wrost service', 'review_id': 284156655, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928} 2025-03-12 09:15:11 [reviews] INFO: Scraped item: {'review': 'A huge disappointment for my family, as we used to love behrouz biryani but now taste has changed so much that it feels like a waste of money

especially Haleem it taste is now🤮, will never recommend behrouz to anyone from now.', 'review_id': 283994518, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928} 2025-03-12 09:15:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18687928&page=1> {'review': 'A huge disappointment for my family, as we used to love behrouz biryani but now taste has changed so much that it feels like a waste of money

especially Haleem it taste is now🤮, will never recommend behrouz to anyone from now.', 'review_id': 283994518, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928} 2025-03-12 09:15:11 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283924791, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928} 2025-03-12 09:15:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18687928&page=1> {'review': '', 'review_id': 283924791, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928} 2025-03-12 09:15:11 [reviews] INFO: Scraped item: {'review': 'the masala was burnt in aftaabi murgh tikka masala, it taste was not good ', 'review_id': 283694240, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928} 2025-03-12 09:15:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18687928&page=1> {'review': 'the masala was burnt in aftaabi murgh tikka masala, it taste was not good ', 'review_id': 283694240, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928} 2025-03-12 09:15:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:15:14 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 18729345, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770856, 'download_latency': 0.9532458782196045, 'depth': 0} 2025-03-12 09:15:14 [reviews] INFO: Scraped item: {'review': 'A lot of masala was there in the biriyani with less chicken pieces. It felt as if the chicken was compensated with additional masala. Overall the experience was pathetic and not up to the mark.', 'review_id': 284333247, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 18729345} 2025-03-12 09:15:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18729345&page=1> {'review': 'A lot of masala was there in the biriyani with less chicken pieces. It felt as if the chicken was compensated with additional masala. Overall the experience was pathetic and not up to the mark.', 'review_id': 284333247, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 18729345} 2025-03-12 09:15:14 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283369148, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 18729345} 2025-03-12 09:15:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18729345&page=1> {'review': '', 'review_id': 283369148, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 18729345} 2025-03-12 09:15:14 [reviews] INFO: Stopping for res_id: 18729345 as reviews are older than 7 days. 2025-03-12 09:15:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:15:18 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai ', 'sub_zone': 'Palladium Mall, Lower Parel', 'platform': 'zomato', 'res_id': 18733959, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770860, 'download_latency': 0.7608187198638916, 'depth': 0} 2025-03-12 09:15:18 [reviews] INFO: Scraped item: {'review': '', 'review_id': 285093356, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai ', 'sub_zone': 'Palladium Mall, Lower Parel', 'platform': 'zomato', 'res_id': 18733959} 2025-03-12 09:15:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18733959&page=1> {'review': '', 'review_id': 285093356, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai ', 'sub_zone': 'Palladium Mall, Lower Parel', 'platform': 'zomato', 'res_id': 18733959} 2025-03-12 09:15:18 [reviews] INFO: Stopping for res_id: 18733959 as reviews are older than 7 days. 2025-03-12 09:15:21 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:15:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:15:28 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:15:31 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:15:35 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:15:38 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:15:42 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:15:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:15:46 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770890, 'download_latency': 0.9181430339813232, 'depth': 0} 2025-03-12 09:15:46 [reviews] INFO: Scraped item: {'review': 'Ordered during Ramadan, and the experience was wonderful! The dishes were flavorful and arrived hot and fresh, making the meal truly enjoyable.', 'review_id': 285096851, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687} 2025-03-12 09:15:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18735687&page=1> {'review': 'Ordered during Ramadan, and the experience was wonderful! The dishes were flavorful and arrived hot and fresh, making the meal truly enjoyable.', 'review_id': 285096851, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687} 2025-03-12 09:15:46 [reviews] INFO: Scraped item: {'review': 'The Iftar delivery was smooth and timely! The food was fresh with generous portions, and the hygienic packaging was a thoughtful touch.', 'review_id': 285082908, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687} 2025-03-12 09:15:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18735687&page=1> {'review': 'The Iftar delivery was smooth and timely! The food was fresh with generous portions, and the hygienic packaging was a thoughtful touch.', 'review_id': 285082908, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687} 2025-03-12 09:15:46 [reviews] INFO: Scraped item: {'review': 'the mutton biryani quality is totally perfect..
but the price for it was not worthy...
307 was not at all worthy,the portion was too small and insufficient for 1 person ', 'review_id': 285037781, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687} 2025-03-12 09:15:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18735687&page=1> {'review': 'the mutton biryani quality is totally perfect..
but the price for it was not worthy...
307 was not at all worthy,the portion was too small and insufficient for 1 person ', 'review_id': 285037781, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687} 2025-03-12 09:15:46 [reviews] INFO: Scraped item: {'review': 'Ordered Iftar, and the service was seamless! The dishes were hot and fresh with a perfect balance of spices, and the safe packaging kept everything warm', 'review_id': 285033031, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687} 2025-03-12 09:15:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18735687&page=1> {'review': 'Ordered Iftar, and the service was seamless! The dishes were hot and fresh with a perfect balance of spices, and the safe packaging kept everything warm', 'review_id': 285033031, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687} 2025-03-12 09:15:46 [reviews] INFO: Scraped item: {'review': 'Tried Persian Darbar’s Ramadan specials for delivery, and it was a fantastic choice! The food was delicious with authentic flavors, and the delivery met expectations perfectly', 'review_id': 285032566, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687} 2025-03-12 09:15:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18735687&page=1> {'review': 'Tried Persian Darbar’s Ramadan specials for delivery, and it was a fantastic choice! The food was delicious with authentic flavors, and the delivery met expectations perfectly', 'review_id': 285032566, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687} 2025-03-12 09:15:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:15:53 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:15:56 [scrapy.extensions.logstats] INFO: Crawled 81 pages (at 5 pages/min), scraped 266 items (at 18 items/min) 2025-03-12 09:15:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:16:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:16:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:16:06 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 77, 'brand_name': 'Biggies Burger', 'city': 'Bangalore', 'sub_zone': 'Church Street', 'platform': 'zomato', 'res_id': 18738761, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770906, 'download_latency': 0.8903758525848389, 'depth': 0} 2025-03-12 09:16:06 [reviews] INFO: Stopping for res_id: 18738761 as reviews are older than 7 days. 2025-03-12 09:16:10 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:16:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:16:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:16:19 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770918, 'download_latency': 0.8237156867980957, 'depth': 0} 2025-03-12 09:16:19 [reviews] INFO: Scraped item: {'review': '', 'review_id': 285002389, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991} 2025-03-12 09:16:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18746991&page=1> {'review': '', 'review_id': 285002389, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991} 2025-03-12 09:16:19 [reviews] INFO: Scraped item: {'review': 'only 2 pcs of chicken in 1/2 kg biryani is it a joke', 'review_id': 284777632, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991} 2025-03-12 09:16:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18746991&page=1> {'review': 'only 2 pcs of chicken in 1/2 kg biryani is it a joke', 'review_id': 284777632, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991} 2025-03-12 09:16:19 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284688936, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991} 2025-03-12 09:16:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18746991&page=1> {'review': '', 'review_id': 284688936, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991} 2025-03-12 09:16:19 [reviews] INFO: Scraped item: {'review': 'Pathetic experience, it was very messy', 'review_id': 284054061, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991} 2025-03-12 09:16:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18746991&page=1> {'review': 'Pathetic experience, it was very messy', 'review_id': 284054061, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991} 2025-03-12 09:16:19 [reviews] INFO: Scraped item: {'review': 'Food was really good. No doubt ', 'review_id': 283922130, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991} 2025-03-12 09:16:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18746991&page=1> {'review': 'Food was really good. No doubt ', 'review_id': 283922130, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991} 2025-03-12 09:16:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:16:26 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:16:28 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:16:30 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:16:34 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:16:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:16:38 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770938, 'download_latency': 0.894526481628418, 'depth': 0} 2025-03-12 09:16:38 [reviews] INFO: Scraped item: {'review': 'absolutely terrible
the taste was bland and it was zero spicy
i feel robbed !!😫', 'review_id': 285186128, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110} 2025-03-12 09:16:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18780110&page=1> {'review': 'absolutely terrible
the taste was bland and it was zero spicy
i feel robbed !!😫', 'review_id': 285186128, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110} 2025-03-12 09:16:38 [reviews] INFO: Scraped item: {'review': 'the gravy has fully gone out from the bowl ', 'review_id': 285159625, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110} 2025-03-12 09:16:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18780110&page=1> {'review': 'the gravy has fully gone out from the bowl ', 'review_id': 285159625, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110} 2025-03-12 09:16:38 [reviews] INFO: Scraped item: {'review': 'taste was great, but had a thankful of oil in the noodles, 4 bits of chicken i would say around 1 cm x 1 cm.
paid for the fried noodles extra, got 2 spoonful for fried noodles.
bowl quantity was amazingly good, enough for 1 person.
so customers, u get what you pay, so dont get misguided with the 50% off offer', 'review_id': 284785032, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110} 2025-03-12 09:16:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18780110&page=1> {'review': 'taste was great, but had a thankful of oil in the noodles, 4 bits of chicken i would say around 1 cm x 1 cm.
paid for the fried noodles extra, got 2 spoonful for fried noodles.
bowl quantity was amazingly good, enough for 1 person.
so customers, u get what you pay, so dont get misguided with the 50% off offer', 'review_id': 284785032, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110} 2025-03-12 09:16:38 [reviews] INFO: Scraped item: {'review': "Both dishes didn't have taste at all. It's my favourite place to order Chinese food, but got disappointed.", 'review_id': 284647403, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110} 2025-03-12 09:16:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18780110&page=1> {'review': "Both dishes didn't have taste at all. It's my favourite place to order Chinese food, but got disappointed.", 'review_id': 284647403, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110} 2025-03-12 09:16:38 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284599258, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110} 2025-03-12 09:16:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18780110&page=1> {'review': '', 'review_id': 284599258, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110} 2025-03-12 09:16:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:16:40 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Navi Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 18789443, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770942, 'download_latency': 0.7882554531097412, 'depth': 0} 2025-03-12 09:16:40 [reviews] INFO: Scraped item: {'review': 'received veg hakka noodles instead of chicken noodles, veggies were chopped in large pieces ', 'review_id': 284334493, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Navi Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 18789443} 2025-03-12 09:16:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18789443&page=1> {'review': 'received veg hakka noodles instead of chicken noodles, veggies were chopped in large pieces ', 'review_id': 284334493, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Navi Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 18789443} 2025-03-12 09:16:40 [reviews] INFO: Scraped item: {'review': 'food overall here is good and delicious..', 'review_id': 283857595, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Navi Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 18789443} 2025-03-12 09:16:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18789443&page=1> {'review': 'food overall here is good and delicious..', 'review_id': 283857595, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Navi Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 18789443} 2025-03-12 09:16:40 [reviews] INFO: Scraped item: {'review': 'Vegetable might be chopped smaller.', 'review_id': 283536540, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Navi Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 18789443} 2025-03-12 09:16:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18789443&page=1> {'review': 'Vegetable might be chopped smaller.', 'review_id': 283536540, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Navi Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 18789443} 2025-03-12 09:16:40 [reviews] INFO: Stopping for res_id: 18789443 as reviews are older than 7 days. 2025-03-12 09:16:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:16:44 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770947, 'download_latency': 0.8351178169250488, 'depth': 0} 2025-03-12 09:16:44 [reviews] INFO: Scraped item: {'review': 'nice ', 'review_id': 285270912, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-12', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648} 2025-03-12 09:16:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18806648&page=1> {'review': 'nice ', 'review_id': 285270912, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-12', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648} 2025-03-12 09:16:44 [reviews] INFO: Scraped item: {'review': 'one item was missing ', 'review_id': 283893684, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648} 2025-03-12 09:16:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18806648&page=1> {'review': 'one item was missing ', 'review_id': 283893684, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648} 2025-03-12 09:16:44 [reviews] INFO: Scraped item: {'review': "doesn't look fresh at all order at 1 30 am", 'review_id': 283796201, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648} 2025-03-12 09:16:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18806648&page=1> {'review': "doesn't look fresh at all order at 1 30 am", 'review_id': 283796201, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648} 2025-03-12 09:16:44 [reviews] INFO: Scraped item: {'review': 'too salty ', 'review_id': 283525880, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648} 2025-03-12 09:16:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18806648&page=1> {'review': 'too salty ', 'review_id': 283525880, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648} 2025-03-12 09:16:44 [reviews] INFO: Scraped item: {'review': 'ordered handi biryani, but get biryani in a box.. Not satisfied', 'review_id': 283420082, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648} 2025-03-12 09:16:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18806648&page=1> {'review': 'ordered handi biryani, but get biryani in a box.. Not satisfied', 'review_id': 283420082, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648} 2025-03-12 09:16:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:16:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:16:53 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:16:56 [scrapy.extensions.logstats] INFO: Crawled 86 pages (at 5 pages/min), scraped 284 items (at 18 items/min) 2025-03-12 09:16:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:17:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:17:06 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:17:09 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:17:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:17:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:17:17 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770980, 'download_latency': 3.2178027629852295, 'depth': 0} 2025-03-12 09:17:17 [reviews] INFO: Scraped item: {'review': 'Loved the biryani', 'review_id': 285216171, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839} 2025-03-12 09:17:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18852839&page=1> {'review': 'Loved the biryani', 'review_id': 285216171, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839} 2025-03-12 09:17:17 [reviews] INFO: Scraped item: {'review': 'last tym package was good quantity was good. this time spilled all over', 'review_id': 285197458, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839} 2025-03-12 09:17:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18852839&page=1> {'review': 'last tym package was good quantity was good. this time spilled all over', 'review_id': 285197458, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839} 2025-03-12 09:17:17 [reviews] INFO: Scraped item: {'review': 'raita spilled over every where', 'review_id': 285112561, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839} 2025-03-12 09:17:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18852839&page=1> {'review': 'raita spilled over every where', 'review_id': 285112561, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839} 2025-03-12 09:17:17 [reviews] INFO: Scraped item: {'review': 'good 👍', 'review_id': 284991916, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839} 2025-03-12 09:17:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18852839&page=1> {'review': 'good 👍', 'review_id': 284991916, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839} 2025-03-12 09:17:17 [reviews] INFO: Scraped item: {'review': 'Always satisfying', 'review_id': 284450486, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839} 2025-03-12 09:17:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18852839&page=1> {'review': 'Always satisfying', 'review_id': 284450486, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839} 2025-03-12 09:17:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:17:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:17:28 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:17:33 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:17:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:17:37 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 18887194, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741770999, 'download_latency': 2.255396604537964, 'depth': 0} 2025-03-12 09:17:37 [reviews] ERROR: Unrecognized relative_date format: 37 minutes ago 2025-03-12 09:17:37 [reviews] INFO: Stopping for res_id: 18887194 due to unrecognized date format: 37 minutes ago. 2025-03-12 09:17:39 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:17:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:17:43 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771005, 'download_latency': 0.8936166763305664, 'depth': 0} 2025-03-12 09:17:43 [reviews] INFO: Scraped item: {'review': "too poor Quality, Don't try it", 'review_id': 285225049, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094} 2025-03-12 09:17:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18934094&page=1> {'review': "too poor Quality, Don't try it", 'review_id': 285225049, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094} 2025-03-12 09:17:43 [reviews] INFO: Scraped item: {'review': "Perfect blend of flavours as expected. Mahesh is truly a gem. He's cordial and ensures customer satisfaction to full extent ", 'review_id': 285213644, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094} 2025-03-12 09:17:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18934094&page=1> {'review': "Perfect blend of flavours as expected. Mahesh is truly a gem. He's cordial and ensures customer satisfaction to full extent ", 'review_id': 285213644, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094} 2025-03-12 09:17:43 [reviews] INFO: Scraped item: {'review': 'mutton is very very delecious thank you for dis taste ... i m super happy with your service ...', 'review_id': 285197868, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094} 2025-03-12 09:17:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18934094&page=1> {'review': 'mutton is very very delecious thank you for dis taste ... i m super happy with your service ...', 'review_id': 285197868, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094} 2025-03-12 09:17:43 [reviews] INFO: Scraped item: {'review': '', 'review_id': 285160429, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094} 2025-03-12 09:17:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18934094&page=1> {'review': '', 'review_id': 285160429, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094} 2025-03-12 09:17:43 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284815780, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094} 2025-03-12 09:17:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18934094&page=1> {'review': '', 'review_id': 284815780, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094} 2025-03-12 09:17:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:17:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:17:53 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:17:56 [scrapy.extensions.logstats] INFO: Crawled 89 pages (at 3 pages/min), scraped 294 items (at 10 items/min) 2025-03-12 09:17:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:18:01 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:18:04 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:18:08 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:18:11 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:18:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:18:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:18:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:18:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:18:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:18:29 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 71, 'brand_name': "Raju's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18939360, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771053, 'download_latency': 1.1941006183624268, 'depth': 0} 2025-03-12 09:18:29 [reviews] INFO: Scraped item: {'review': 'Added colour even after requesting', 'review_id': 283395400, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 71, 'brand_name': "Raju's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18939360} 2025-03-12 09:18:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18939360&page=1> {'review': 'Added colour even after requesting', 'review_id': 283395400, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 71, 'brand_name': "Raju's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18939360} 2025-03-12 09:18:29 [reviews] INFO: Stopping for res_id: 18939360 as reviews are older than 7 days. 2025-03-12 09:18:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:18:33 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18997398, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771058, 'download_latency': 1.358093500137329, 'depth': 0} 2025-03-12 09:18:33 [reviews] INFO: Scraped item: {'review': 'good ', 'review_id': 284988925, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18997398} 2025-03-12 09:18:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18997398&page=1> {'review': 'good ', 'review_id': 284988925, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18997398} 2025-03-12 09:18:33 [reviews] INFO: Scraped item: {'review': 'Was not great', 'review_id': 284759522, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18997398} 2025-03-12 09:18:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18997398&page=1> {'review': 'Was not great', 'review_id': 284759522, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18997398} 2025-03-12 09:18:33 [reviews] INFO: Scraped item: {'review': 'Order delayed by 1hr 30mins', 'review_id': 284714313, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18997398} 2025-03-12 09:18:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18997398&page=1> {'review': 'Order delayed by 1hr 30mins', 'review_id': 284714313, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18997398} 2025-03-12 09:18:33 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284644819, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18997398} 2025-03-12 09:18:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18997398&page=1> {'review': '', 'review_id': 284644819, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18997398} 2025-03-12 09:18:33 [reviews] INFO: Scraped item: {'review': 'Packaging charges 45 is too much . quantity 250 gm is less of value rupees 199 . no needed varieties of Packaging . Quality and quantity is more important.
but test is good 👍 ', 'review_id': 284609234, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18997398} 2025-03-12 09:18:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18997398&page=1> {'review': 'Packaging charges 45 is too much . quantity 250 gm is less of value rupees 199 . no needed varieties of Packaging . Quality and quantity is more important.
but test is good 👍 ', 'review_id': 284609234, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18997398} 2025-03-12 09:18:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:18:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:18:43 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Castle Mill', 'platform': 'zomato', 'res_id': 19022949, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771064, 'download_latency': 3.4075043201446533, 'depth': 0} 2025-03-12 09:18:43 [reviews] INFO: Scraped item: {'review': 'Qty less', 'review_id': 284850362, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Castle Mill', 'platform': 'zomato', 'res_id': 19022949} 2025-03-12 09:18:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19022949&page=1> {'review': 'Qty less', 'review_id': 284850362, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Castle Mill', 'platform': 'zomato', 'res_id': 19022949} 2025-03-12 09:18:43 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284605130, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Castle Mill', 'platform': 'zomato', 'res_id': 19022949} 2025-03-12 09:18:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19022949&page=1> {'review': '', 'review_id': 284605130, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Castle Mill', 'platform': 'zomato', 'res_id': 19022949} 2025-03-12 09:18:43 [reviews] INFO: Scraped item: {'review': "it's completely cold ", 'review_id': 284587721, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Castle Mill', 'platform': 'zomato', 'res_id': 19022949} 2025-03-12 09:18:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19022949&page=1> {'review': "it's completely cold ", 'review_id': 284587721, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Castle Mill', 'platform': 'zomato', 'res_id': 19022949} 2025-03-12 09:18:43 [reviews] INFO: Scraped item: {'review': 'cold and soggy rolls', 'review_id': 283518198, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Castle Mill', 'platform': 'zomato', 'res_id': 19022949} 2025-03-12 09:18:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19022949&page=1> {'review': 'cold and soggy rolls', 'review_id': 283518198, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Castle Mill', 'platform': 'zomato', 'res_id': 19022949} 2025-03-12 09:18:43 [reviews] INFO: Stopping for res_id: 19022949 as reviews are older than 7 days. 2025-03-12 09:18:44 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:18:48 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:18:51 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:18:55 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:18:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-12 09:18:57 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-12 09:18:57 [scrapy.extensions.logstats] INFO: Crawled 92 pages (at 3 pages/min), scraped 304 items (at 10 items/min) 2025-03-12 09:19:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:19:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:19:04 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:19:09 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:19:12 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:19:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:19:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:19:23 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:19:26 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:19:33 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:19:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:19:34 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771114, 'download_latency': 4.513058185577393, 'depth': 0} 2025-03-12 09:19:34 [reviews] INFO: Scraped item: {'review': 'perfect', 'review_id': 285037836, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625} 2025-03-12 09:19:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19104625&page=1> {'review': 'perfect', 'review_id': 285037836, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625} 2025-03-12 09:19:34 [reviews] INFO: Scraped item: {'review': 'Too spicy', 'review_id': 284598297, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625} 2025-03-12 09:19:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19104625&page=1> {'review': 'Too spicy', 'review_id': 284598297, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625} 2025-03-12 09:19:34 [reviews] INFO: Scraped item: {'review': 'Cold', 'review_id': 284594744, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625} 2025-03-12 09:19:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19104625&page=1> {'review': 'Cold', 'review_id': 284594744, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625} 2025-03-12 09:19:34 [reviews] INFO: Scraped item: {'review': 'Biryani was good 1 star
raita was good 1 star
Salan was good 1 star
Complementary Salad Onion Rings 1 star
overall customer support as they call you and adjust your food as per your requirements and sometimes provide you complementary items like salad. And my delivery partner Kalu deliver my order in no time. One shoutout for him', 'review_id': 284456822, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625} 2025-03-12 09:19:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19104625&page=1> {'review': 'Biryani was good 1 star
raita was good 1 star
Salan was good 1 star
Complementary Salad Onion Rings 1 star
overall customer support as they call you and adjust your food as per your requirements and sometimes provide you complementary items like salad. And my delivery partner Kalu deliver my order in no time. One shoutout for him', 'review_id': 284456822, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625} 2025-03-12 09:19:34 [reviews] INFO: Scraped item: {'review': 'Tasty food', 'review_id': 284434547, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625} 2025-03-12 09:19:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19104625&page=1> {'review': 'Tasty food', 'review_id': 284434547, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625} 2025-03-12 09:19:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:19:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:19:44 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:19:47 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:19:51 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:19:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:19:56 [scrapy.extensions.logstats] INFO: Crawled 93 pages (at 1 pages/min), scraped 309 items (at 5 items/min) 2025-03-12 09:19:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:20:01 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:20:04 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:20:09 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:20:13 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:20:17 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:20:21 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:20:29 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:20:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:20:30 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771166, 'download_latency': 5.238174915313721, 'depth': 0} 2025-03-12 09:20:30 [reviews] INFO: Scraped item: {'review': '', 'review_id': 285033289, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928} 2025-03-12 09:20:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19119928&page=1> {'review': '', 'review_id': 285033289, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928} 2025-03-12 09:20:30 [reviews] INFO: Scraped item: {'review': 'I Got sick of the sandwich/ chilli sauce.', 'review_id': 284935997, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928} 2025-03-12 09:20:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19119928&page=1> {'review': 'I Got sick of the sandwich/ chilli sauce.', 'review_id': 284935997, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928} 2025-03-12 09:20:30 [reviews] INFO: Scraped item: {'review': 'The bread was horrible and dry', 'review_id': 284934170, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928} 2025-03-12 09:20:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19119928&page=1> {'review': 'The bread was horrible and dry', 'review_id': 284934170, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928} 2025-03-12 09:20:30 [reviews] INFO: Scraped item: {'review': 'Great coffee!!', 'review_id': 284801905, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928} 2025-03-12 09:20:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19119928&page=1> {'review': 'Great coffee!!', 'review_id': 284801905, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928} 2025-03-12 09:20:30 [reviews] INFO: Scraped item: {'review': 'After waiting in line for 40 mins the staff doesn’t even let you eat in peace. There is a rush to push you out! Don’t come if you want a peaceful catchup with your friend', 'review_id': 284347176, 'rating': '2', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928} 2025-03-12 09:20:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19119928&page=1> {'review': 'After waiting in line for 40 mins the staff doesn’t even let you eat in peace. There is a rush to push you out! Don’t come if you want a peaceful catchup with your friend', 'review_id': 284347176, 'rating': '2', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928} 2025-03-12 09:20:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:20:34 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 45, 'brand_name': 'The Shaka Cafe', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19123522, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771174, 'download_latency': 1.4130470752716064, 'depth': 0} 2025-03-12 09:20:34 [reviews] INFO: Scraped item: {'review': 'Chef Vikas and Team Jay & Pratik, food awesome, service was excellent', 'review_id': 285149304, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 45, 'brand_name': 'The Shaka Cafe', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19123522} 2025-03-12 09:20:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19123522&page=1> {'review': 'Chef Vikas and Team Jay & Pratik, food awesome, service was excellent', 'review_id': 285149304, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 45, 'brand_name': 'The Shaka Cafe', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19123522} 2025-03-12 09:20:34 [reviews] INFO: Scraped item: {'review': 'The food, ambiance & shaka team is amazing.
Must visit place in Ahmedabad', 'review_id': 284796114, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 45, 'brand_name': 'The Shaka Cafe', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19123522} 2025-03-12 09:20:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19123522&page=1> {'review': 'The food, ambiance & shaka team is amazing.
Must visit place in Ahmedabad', 'review_id': 284796114, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 45, 'brand_name': 'The Shaka Cafe', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19123522} 2025-03-12 09:20:34 [reviews] INFO: Scraped item: {'review': "perfect place for anyday, my go to place. will recommend everyone to try sushi, you'll be fan of this place", 'review_id': 284303554, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 45, 'brand_name': 'The Shaka Cafe', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19123522} 2025-03-12 09:20:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19123522&page=1> {'review': "perfect place for anyday, my go to place. will recommend everyone to try sushi, you'll be fan of this place", 'review_id': 284303554, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 45, 'brand_name': 'The Shaka Cafe', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19123522} 2025-03-12 09:20:34 [reviews] INFO: Stopping for res_id: 19123522 as reviews are older than 7 days. 2025-03-12 09:20:37 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:20:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:20:44 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:20:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:20:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:20:54 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:20:56 [scrapy.extensions.logstats] INFO: Crawled 95 pages (at 2 pages/min), scraped 317 items (at 8 items/min) 2025-03-12 09:20:58 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:21:01 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:21:05 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:21:10 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:21:13 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:21:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:21:18 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 38, 'brand_name': 'Lavonne', 'city': 'Bangalore', 'sub_zone': 'St. Marks Road', 'platform': 'zomato', 'res_id': 19142873, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771218, 'download_latency': 1.2859678268432617, 'depth': 0} 2025-03-12 09:21:18 [reviews] INFO: Stopping for res_id: 19142873 as reviews are older than 7 days. 2025-03-12 09:21:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:21:22 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771222, 'download_latency': 1.4474129676818848, 'depth': 0} 2025-03-12 09:21:22 [reviews] INFO: Scraped item: {'review': 'Toooooo Bad. No taste. Only dry rice. I m really shocked.', 'review_id': 284593210, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838} 2025-03-12 09:21:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19168838&page=1> {'review': 'Toooooo Bad. No taste. Only dry rice. I m really shocked.', 'review_id': 284593210, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838} 2025-03-12 09:21:22 [reviews] INFO: Scraped item: {'review': 'Biriyani was sent with only rice. No vegetables', 'review_id': 284562592, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838} 2025-03-12 09:21:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19168838&page=1> {'review': 'Biriyani was sent with only rice. No vegetables', 'review_id': 284562592, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838} 2025-03-12 09:21:22 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284174070, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838} 2025-03-12 09:21:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19168838&page=1> {'review': '', 'review_id': 284174070, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838} 2025-03-12 09:21:22 [reviews] INFO: Scraped item: {'review': 'It was more like a chicken masala gravy rather than Haleem, No fried onions on top also (bhai haleem ke naam pe kya de rahe ho aap)', 'review_id': 283739420, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838} 2025-03-12 09:21:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19168838&page=1> {'review': 'It was more like a chicken masala gravy rather than Haleem, No fried onions on top also (bhai haleem ke naam pe kya de rahe ho aap)', 'review_id': 283739420, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838} 2025-03-12 09:21:22 [reviews] INFO: Scraped item: {'review': 'What fragrance... delicious..super handi packaging.... excellent ', 'review_id': 283525711, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838} 2025-03-12 09:21:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19168838&page=1> {'review': 'What fragrance... delicious..super handi packaging.... excellent ', 'review_id': 283525711, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838} 2025-03-12 09:21:25 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:21:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:21:29 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771230, 'download_latency': 1.4102256298065186, 'depth': 0} 2025-03-12 09:21:29 [reviews] INFO: Scraped item: {'review': 'this was only the second time we tried Bikkgane, our first experience was amazing! But today we did not got simple masala rice in the name of Biryani which was very dry and instantly left a bad taste in our mind about Bikkgane. Andhra Mutton Fry was decent but mutton pieces were not as tender as earlier. ', 'review_id': 285228242, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-12', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777} 2025-03-12 09:21:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19180777&page=1> {'review': 'this was only the second time we tried Bikkgane, our first experience was amazing! But today we did not got simple masala rice in the name of Biryani which was very dry and instantly left a bad taste in our mind about Bikkgane. Andhra Mutton Fry was decent but mutton pieces were not as tender as earlier. ', 'review_id': 285228242, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-12', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777} 2025-03-12 09:21:29 [reviews] INFO: Scraped item: {'review': 'Shitty food , waste of money', 'review_id': 285186732, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777} 2025-03-12 09:21:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19180777&page=1> {'review': 'Shitty food , waste of money', 'review_id': 285186732, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777} 2025-03-12 09:21:29 [reviews] INFO: Scraped item: {'review': 'loss of instruction seen', 'review_id': 284591695, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777} 2025-03-12 09:21:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19180777&page=1> {'review': 'loss of instruction seen', 'review_id': 284591695, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777} 2025-03-12 09:21:29 [reviews] INFO: Scraped item: {'review': 'Delivered pulaav', 'review_id': 284347210, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777} 2025-03-12 09:21:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19180777&page=1> {'review': 'Delivered pulaav', 'review_id': 284347210, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777} 2025-03-12 09:21:29 [reviews] INFO: Scraped item: {'review': 'cockroach in food ', 'review_id': 284334830, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777} 2025-03-12 09:21:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19180777&page=1> {'review': 'cockroach in food ', 'review_id': 284334830, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777} 2025-03-12 09:21:31 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:21:35 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:21:37 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:21:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:21:45 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:21:50 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:21:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:21:56 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 19194488, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771255, 'download_latency': 2.4752256870269775, 'depth': 0} 2025-03-12 09:21:56 [reviews] INFO: Scraped item: {'review': "very dry and expensive not worth no taste it's tasteless ", 'review_id': 284522327, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 19194488} 2025-03-12 09:21:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19194488&page=1> {'review': "very dry and expensive not worth no taste it's tasteless ", 'review_id': 284522327, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 19194488} 2025-03-12 09:21:56 [reviews] INFO: Scraped item: {'review': 'Quantity is less. Served with accompaniments such as mint chutney and onion salad', 'review_id': 284340417, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 19194488} 2025-03-12 09:21:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19194488&page=1> {'review': 'Quantity is less. Served with accompaniments such as mint chutney and onion salad', 'review_id': 284340417, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 19194488} 2025-03-12 09:21:56 [reviews] INFO: Scraped item: {'review': 'Rice was very tasty. somehow the chicken was ok. but all in all it was good.', 'review_id': 284299992, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 19194488} 2025-03-12 09:21:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19194488&page=1> {'review': 'Rice was very tasty. somehow the chicken was ok. but all in all it was good.', 'review_id': 284299992, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 19194488} 2025-03-12 09:21:56 [reviews] INFO: Scraped item: {'review': 'The packaging was excellent, a really good experience. When it is actually served in an hundi.
The kuthal biryani was so tasty and uff! The gajar halwa, mind-blowing so yummy so yummy. This is to the chef. The gajar was perfectly cooked perfectly sweeten. Amazing loved it', 'review_id': 284168398, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 19194488} 2025-03-12 09:21:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19194488&page=1> {'review': 'The packaging was excellent, a really good experience. When it is actually served in an hundi.
The kuthal biryani was so tasty and uff! The gajar halwa, mind-blowing so yummy so yummy. This is to the chef. The gajar was perfectly cooked perfectly sweeten. Amazing loved it', 'review_id': 284168398, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 19194488} 2025-03-12 09:21:56 [reviews] INFO: Scraped item: {'review': 'no teste at all..Try House of Biryan....for much better biryani ', 'review_id': 284143826, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 19194488} 2025-03-12 09:21:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19194488&page=1> {'review': 'no teste at all..Try House of Biryan....for much better biryani ', 'review_id': 284143826, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 19194488} 2025-03-12 09:21:56 [scrapy.extensions.logstats] INFO: Crawled 99 pages (at 4 pages/min), scraped 332 items (at 15 items/min) 2025-03-12 09:21:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:21:59 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771258, 'download_latency': 2.1480207443237305, 'depth': 0} 2025-03-12 09:21:59 [reviews] INFO: Scraped item: {'review': 'Biryani was dry', 'review_id': 284565251, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026} 2025-03-12 09:21:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19195026&page=1> {'review': 'Biryani was dry', 'review_id': 284565251, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026} 2025-03-12 09:21:59 [reviews] INFO: Scraped item: {'review': 'hopeless, deliverd 1 handi instead if 2 ordered. now not giving refund nor replacement', 'review_id': 284356011, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026} 2025-03-12 09:21:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19195026&page=1> {'review': 'hopeless, deliverd 1 handi instead if 2 ordered. now not giving refund nor replacement', 'review_id': 284356011, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026} 2025-03-12 09:21:59 [reviews] INFO: Scraped item: {'review': 'Quantity is quite less.', 'review_id': 284144775, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026} 2025-03-12 09:21:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19195026&page=1> {'review': 'Quantity is quite less.', 'review_id': 284144775, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026} 2025-03-12 09:21:59 [reviews] INFO: Scraped item: {'review': 'Quantity was less with only one piece👎🏻', 'review_id': 283851435, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026} 2025-03-12 09:21:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19195026&page=1> {'review': 'Quantity was less with only one piece👎🏻', 'review_id': 283851435, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026} 2025-03-12 09:21:59 [reviews] INFO: Scraped item: {'review': 'food is delivered in damaged condition ', 'review_id': 283757175, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026} 2025-03-12 09:21:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19195026&page=1> {'review': 'food is delivered in damaged condition ', 'review_id': 283757175, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026} 2025-03-12 09:22:02 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:22:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:22:02 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'K Star Mall', 'platform': 'zomato', 'res_id': 19205663, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771262, 'download_latency': 2.356243848800659, 'depth': 0} 2025-03-12 09:22:02 [reviews] INFO: Stopping for res_id: 19205663 as reviews are older than 7 days. 2025-03-12 09:22:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:22:09 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 32, 'brand_name': 'Third Wave Coffee', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19207047, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771270, 'download_latency': 2.851898193359375, 'depth': 0} 2025-03-12 09:22:09 [reviews] INFO: Scraped item: {'review': 'good', 'review_id': 285018471, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 32, 'brand_name': 'Third Wave Coffee', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19207047} 2025-03-12 09:22:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19207047&page=1> {'review': 'good', 'review_id': 285018471, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 32, 'brand_name': 'Third Wave Coffee', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19207047} 2025-03-12 09:22:09 [reviews] INFO: Stopping for res_id: 19207047 as reviews are older than 7 days. 2025-03-12 09:22:10 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:22:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:22:17 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 12, 'brand_name': 'Kuai Kitchen', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19247726, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771279, 'download_latency': 2.6415634155273438, 'depth': 0} 2025-03-12 09:22:17 [reviews] INFO: Scraped item: {'review': '', 'review_id': 285011264, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 12, 'brand_name': 'Kuai Kitchen', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19247726} 2025-03-12 09:22:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19247726&page=1> {'review': '', 'review_id': 285011264, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 12, 'brand_name': 'Kuai Kitchen', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19247726} 2025-03-12 09:22:17 [reviews] INFO: Scraped item: {'review': 'Small Quantities - what has been advertised versus what is served', 'review_id': 284546346, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 12, 'brand_name': 'Kuai Kitchen', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19247726} 2025-03-12 09:22:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19247726&page=1> {'review': 'Small Quantities - what has been advertised versus what is served', 'review_id': 284546346, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 12, 'brand_name': 'Kuai Kitchen', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19247726} 2025-03-12 09:22:17 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284495133, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 12, 'brand_name': 'Kuai Kitchen', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19247726} 2025-03-12 09:22:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19247726&page=1> {'review': '', 'review_id': 284495133, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 12, 'brand_name': 'Kuai Kitchen', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19247726} 2025-03-12 09:22:17 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283313833, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 12, 'brand_name': 'Kuai Kitchen', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19247726} 2025-03-12 09:22:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19247726&page=1> {'review': '', 'review_id': 283313833, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 12, 'brand_name': 'Kuai Kitchen', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19247726} 2025-03-12 09:22:17 [reviews] INFO: Stopping for res_id: 19247726 as reviews are older than 7 days. 2025-03-12 09:22:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:22:19 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771283, 'download_latency': 1.8154840469360352, 'depth': 0} 2025-03-12 09:22:19 [reviews] INFO: Scraped item: {'review': 'would expect a better packaging for that price and better taste than competition ', 'review_id': 285199886, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266} 2025-03-12 09:22:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19257266&page=1> {'review': 'would expect a better packaging for that price and better taste than competition ', 'review_id': 285199886, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266} 2025-03-12 09:22:19 [reviews] INFO: Scraped item: {'review': 'quality speaks ', 'review_id': 284541555, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266} 2025-03-12 09:22:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19257266&page=1> {'review': 'quality speaks ', 'review_id': 284541555, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266} 2025-03-12 09:22:19 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284054226, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266} 2025-03-12 09:22:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19257266&page=1> {'review': '', 'review_id': 284054226, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266} 2025-03-12 09:22:19 [reviews] INFO: Scraped item: {'review': 'The cake came totally broken into pieces very disappointed...despite charging extra money the delivery is very poor . Will never recommend anyone to order', 'review_id': 283677899, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266} 2025-03-12 09:22:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19257266&page=1> {'review': 'The cake came totally broken into pieces very disappointed...despite charging extra money the delivery is very poor . Will never recommend anyone to order', 'review_id': 283677899, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266} 2025-03-12 09:22:19 [reviews] INFO: Stopping for res_id: 19257266 as reviews are older than 7 days. 2025-03-12 09:22:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:22:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:22:28 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:22:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:22:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:22:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:22:43 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:22:48 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:22:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:22:52 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 52, 'brand_name': 'The Flaming Bowl', 'city': 'Kolkata', 'sub_zone': 'Bhawanipur', 'platform': 'zomato', 'res_id': 19270163, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771316, 'download_latency': 1.6498310565948486, 'depth': 0} 2025-03-12 09:22:52 [reviews] INFO: Stopping for res_id: 19270163 as reviews are older than 7 days. 2025-03-12 09:22:55 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:22:56 [scrapy.extensions.logstats] INFO: Crawled 105 pages (at 6 pages/min), scraped 346 items (at 14 items/min) 2025-03-12 09:22:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:23:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:23:03 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 81, 'brand_name': 'Kofuku', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19294645, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771323, 'download_latency': 0.8732597827911377, 'depth': 0} 2025-03-12 09:23:03 [reviews] INFO: Scraped item: {'review': 'the dishes were good but without any ginger or sauces. there was no soy sauce .. sushi cannot be send stand alone', 'review_id': 284848520, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 81, 'brand_name': 'Kofuku', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19294645} 2025-03-12 09:23:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19294645&page=1> {'review': 'the dishes were good but without any ginger or sauces. there was no soy sauce .. sushi cannot be send stand alone', 'review_id': 284848520, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 81, 'brand_name': 'Kofuku', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19294645} 2025-03-12 09:23:03 [reviews] INFO: Stopping for res_id: 19294645 as reviews are older than 7 days. 2025-03-12 09:23:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:23:06 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 19295012, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771329, 'download_latency': 0.8192665576934814, 'depth': 0} 2025-03-12 09:23:06 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284608665, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 19295012} 2025-03-12 09:23:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19295012&page=1> {'review': '', 'review_id': 284608665, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 19295012} 2025-03-12 09:23:06 [reviews] INFO: Scraped item: {'review': 'food was good nd tasty ', 'review_id': 284383295, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 19295012} 2025-03-12 09:23:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19295012&page=1> {'review': 'food was good nd tasty ', 'review_id': 284383295, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 19295012} 2025-03-12 09:23:06 [reviews] INFO: Scraped item: {'review': 'The food they serve is very exquisite and the presentation is neat and clean. The food arrived hot and freshly cooked . Nice', 'review_id': 284347167, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 19295012} 2025-03-12 09:23:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19295012&page=1> {'review': 'The food they serve is very exquisite and the presentation is neat and clean. The food arrived hot and freshly cooked . Nice', 'review_id': 284347167, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 19295012} 2025-03-12 09:23:06 [reviews] INFO: Scraped item: {'review': 'Very fresh very good', 'review_id': 283985242, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 19295012} 2025-03-12 09:23:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19295012&page=1> {'review': 'Very fresh very good', 'review_id': 283985242, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 19295012} 2025-03-12 09:23:06 [reviews] INFO: Scraped item: {'review': 'The taste is good but only 2-3 chaap chopped pieces were added for the whole box. You can either add more chaap pieces or add an option to pay for extra pieces. The quantity provided was in no way justified.', 'review_id': 283378663, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 19295012} 2025-03-12 09:23:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19295012&page=1> {'review': 'The taste is good but only 2-3 chaap chopped pieces were added for the whole box. You can either add more chaap pieces or add an option to pay for extra pieces. The quantity provided was in no way justified.', 'review_id': 283378663, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 19295012} 2025-03-12 09:23:08 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:23:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:23:13 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 19338435, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771337, 'download_latency': 0.837670087814331, 'depth': 0} 2025-03-12 09:23:13 [reviews] INFO: Scraped item: {'review': 'too late delivery ', 'review_id': 285209481, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 19338435} 2025-03-12 09:23:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19338435&page=1> {'review': 'too late delivery ', 'review_id': 285209481, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 19338435} 2025-03-12 09:23:13 [reviews] INFO: Stopping for res_id: 19338435 as reviews are older than 7 days. 2025-03-12 09:23:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:23:17 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 19347326, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771340, 'download_latency': 0.7244563102722168, 'depth': 0} 2025-03-12 09:23:17 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284263248, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 19347326} 2025-03-12 09:23:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19347326&page=1> {'review': '', 'review_id': 284263248, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 19347326} 2025-03-12 09:23:17 [reviews] INFO: Scraped item: {'review': 'I have requested to add message on delivery', 'review_id': 283935317, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 19347326} 2025-03-12 09:23:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19347326&page=1> {'review': 'I have requested to add message on delivery', 'review_id': 283935317, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 19347326} 2025-03-12 09:23:17 [reviews] INFO: Stopping for res_id: 19347326 as reviews are older than 7 days. 2025-03-12 09:23:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:23:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:23:28 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:23:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:23:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:23:39 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:23:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:23:44 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771364, 'download_latency': 0.8365819454193115, 'depth': 0} 2025-03-12 09:23:44 [reviews] INFO: Scraped item: {'review': 'horrible food. gave extreme bloating and stomach issues after eating it. ', 'review_id': 285259274, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-12', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793} 2025-03-12 09:23:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19470793&page=1> {'review': 'horrible food. gave extreme bloating and stomach issues after eating it. ', 'review_id': 285259274, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-12', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793} 2025-03-12 09:23:44 [reviews] INFO: Scraped item: {'review': 'The Butter chicken did not taste like butter chicken at all, it was bland with barely any chicken in the gravy.', 'review_id': 285232039, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-12', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793} 2025-03-12 09:23:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19470793&page=1> {'review': 'The Butter chicken did not taste like butter chicken at all, it was bland with barely any chicken in the gravy.', 'review_id': 285232039, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-12', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793} 2025-03-12 09:23:44 [reviews] INFO: Scraped item: {'review': 'Just dry rice in the name of biryani. Pathetic service', 'review_id': 285210155, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793} 2025-03-12 09:23:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19470793&page=1> {'review': 'Just dry rice in the name of biryani. Pathetic service', 'review_id': 285210155, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793} 2025-03-12 09:23:44 [reviews] INFO: Scraped item: {'review': '', 'review_id': 285172262, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793} 2025-03-12 09:23:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19470793&page=1> {'review': '', 'review_id': 285172262, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793} 2025-03-12 09:23:44 [reviews] INFO: Scraped item: {'review': 'uncooked tandoori ', 'review_id': 284807080, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793} 2025-03-12 09:23:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19470793&page=1> {'review': 'uncooked tandoori ', 'review_id': 284807080, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793} 2025-03-12 09:23:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:23:47 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771368, 'download_latency': 0.8191962242126465, 'depth': 0} 2025-03-12 09:23:47 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284621621, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939} 2025-03-12 09:23:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19494939&page=1> {'review': '', 'review_id': 284621621, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939} 2025-03-12 09:23:47 [reviews] INFO: Scraped item: {'review': 'chicken is not cooked properly!! ', 'review_id': 284262569, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939} 2025-03-12 09:23:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19494939&page=1> {'review': 'chicken is not cooked properly!! ', 'review_id': 284262569, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939} 2025-03-12 09:23:47 [reviews] INFO: Scraped item: {'review': 'Received cold and rice quality is getting poor day by day.', 'review_id': 283772362, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939} 2025-03-12 09:23:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19494939&page=1> {'review': 'Received cold and rice quality is getting poor day by day.', 'review_id': 283772362, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939} 2025-03-12 09:23:47 [reviews] INFO: Scraped item: {'review': "The first thing was that the order was 27 minutes delayed and after all this they gave me this unhygienic cutlery here I'm attaching the photos ", 'review_id': 283760372, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939} 2025-03-12 09:23:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19494939&page=1> {'review': "The first thing was that the order was 27 minutes delayed and after all this they gave me this unhygienic cutlery here I'm attaching the photos ", 'review_id': 283760372, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939} 2025-03-12 09:23:47 [reviews] INFO: Scraped item: {'review': 'biryani taste was very different and does not taste like the usual days. this used to be my favourite biryani but the quality of the biryani has decreased a lot. not recommended this outlet', 'review_id': 283748208, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939} 2025-03-12 09:23:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19494939&page=1> {'review': 'biryani taste was very different and does not taste like the usual days. this used to be my favourite biryani but the quality of the biryani has decreased a lot. not recommended this outlet', 'review_id': 283748208, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939} 2025-03-12 09:23:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:23:51 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771373, 'download_latency': 0.7801980972290039, 'depth': 0} 2025-03-12 09:23:51 [reviews] INFO: Scraped item: {'review': 'Biryani looks like plain rice more . Vegetables are very few . not worth ', 'review_id': 285152122, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084} 2025-03-12 09:23:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19497084&page=1> {'review': 'Biryani looks like plain rice more . Vegetables are very few . not worth ', 'review_id': 285152122, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084} 2025-03-12 09:23:51 [reviews] INFO: Scraped item: {'review': "nice tast and good quality I like it . it's value for money. 😊", 'review_id': 284719802, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084} 2025-03-12 09:23:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19497084&page=1> {'review': "nice tast and good quality I like it . it's value for money. 😊", 'review_id': 284719802, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084} 2025-03-12 09:23:51 [reviews] INFO: Scraped item: {'review': 'Thanks mhd Saif for amazing food', 'review_id': 284711951, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084} 2025-03-12 09:23:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19497084&page=1> {'review': 'Thanks mhd Saif for amazing food', 'review_id': 284711951, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084} 2025-03-12 09:23:51 [reviews] INFO: Scraped item: {'review': 'Mr Mohammad khalid is a good chef. Biryani was very tasty', 'review_id': 284669463, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084} 2025-03-12 09:23:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19497084&page=1> {'review': 'Mr Mohammad khalid is a good chef. Biryani was very tasty', 'review_id': 284669463, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084} 2025-03-12 09:23:51 [reviews] INFO: Scraped item: {'review': 'Thank you md khalid food was too good', 'review_id': 284651935, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084} 2025-03-12 09:23:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19497084&page=1> {'review': 'Thank you md khalid food was too good', 'review_id': 284651935, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084} 2025-03-12 09:23:55 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:23:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-12 09:23:57 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-12 09:23:57 [scrapy.extensions.logstats] INFO: Crawled 112 pages (at 7 pages/min), scraped 370 items (at 24 items/min) 2025-03-12 09:23:59 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:24:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:24:03 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 76, 'brand_name': "AKU'S - The Burger Co.", 'city': 'Gurgaon', 'sub_zone': 'DLF Cyber City', 'platform': 'zomato', 'res_id': 19497106, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771384, 'download_latency': 0.7726902961730957, 'depth': 0} 2025-03-12 09:24:03 [reviews] INFO: Scraped item: {'review': 'Really nice burgers!', 'review_id': 284354434, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 76, 'brand_name': "AKU'S - The Burger Co.", 'city': 'Gurgaon', 'sub_zone': 'DLF Cyber City', 'platform': 'zomato', 'res_id': 19497106} 2025-03-12 09:24:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19497106&page=1> {'review': 'Really nice burgers!', 'review_id': 284354434, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 76, 'brand_name': "AKU'S - The Burger Co.", 'city': 'Gurgaon', 'sub_zone': 'DLF Cyber City', 'platform': 'zomato', 'res_id': 19497106} 2025-03-12 09:24:03 [reviews] INFO: Scraped item: {'review': "Usually Aku's burgers are really good, which is why we order from there. However, today, the burgers were dry, onion rings burnt and fries were not tasty.", 'review_id': 284070255, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 76, 'brand_name': "AKU'S - The Burger Co.", 'city': 'Gurgaon', 'sub_zone': 'DLF Cyber City', 'platform': 'zomato', 'res_id': 19497106} 2025-03-12 09:24:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19497106&page=1> {'review': "Usually Aku's burgers are really good, which is why we order from there. However, today, the burgers were dry, onion rings burnt and fries were not tasty.", 'review_id': 284070255, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 76, 'brand_name': "AKU'S - The Burger Co.", 'city': 'Gurgaon', 'sub_zone': 'DLF Cyber City', 'platform': 'zomato', 'res_id': 19497106} 2025-03-12 09:24:03 [reviews] INFO: Stopping for res_id: 19497106 as reviews are older than 7 days. 2025-03-12 09:24:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:24:07 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 78, 'brand_name': 'Burger Seigneur', 'city': 'Bangalore', 'sub_zone': '1 Sobha', 'platform': 'zomato', 'res_id': 19503146, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771386, 'download_latency': 0.7372126579284668, 'depth': 0} 2025-03-12 09:24:07 [reviews] INFO: Stopping for res_id: 19503146 as reviews are older than 7 days. 2025-03-12 09:24:11 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:24:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:24:16 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771393, 'download_latency': 0.7768683433532715, 'depth': 0} 2025-03-12 09:24:16 [reviews] INFO: Scraped item: {'review': '', 'review_id': 285059740, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567} 2025-03-12 09:24:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19512567&page=1> {'review': '', 'review_id': 285059740, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567} 2025-03-12 09:24:16 [reviews] INFO: Scraped item: {'review': "asked some extra Schezwan sauce,haven't provided ", 'review_id': 284145068, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567} 2025-03-12 09:24:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19512567&page=1> {'review': "asked some extra Schezwan sauce,haven't provided ", 'review_id': 284145068, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567} 2025-03-12 09:24:16 [reviews] INFO: Scraped item: {'review': 'added nonveg momo in veg momo packets', 'review_id': 284040295, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567} 2025-03-12 09:24:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19512567&page=1> {'review': 'added nonveg momo in veg momo packets', 'review_id': 284040295, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567} 2025-03-12 09:24:16 [reviews] INFO: Scraped item: {'review': 'Worst ever experience, food was cold as ice perhaps i choose for noodles & rice i only received noodles', 'review_id': 283533826, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567} 2025-03-12 09:24:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19512567&page=1> {'review': 'Worst ever experience, food was cold as ice perhaps i choose for noodles & rice i only received noodles', 'review_id': 283533826, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567} 2025-03-12 09:24:16 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283390474, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567} 2025-03-12 09:24:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19512567&page=1> {'review': '', 'review_id': 283390474, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567} 2025-03-12 09:24:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:24:21 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Noida', 'sub_zone': 'Chaukhandi', 'platform': 'zomato', 'res_id': 19519013, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771397, 'download_latency': 0.8549365997314453, 'depth': 0} 2025-03-12 09:24:21 [reviews] INFO: Scraped item: {'review': "it's not good ", 'review_id': 284748085, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Noida', 'sub_zone': 'Chaukhandi', 'platform': 'zomato', 'res_id': 19519013} 2025-03-12 09:24:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19519013&page=1> {'review': "it's not good ", 'review_id': 284748085, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Noida', 'sub_zone': 'Chaukhandi', 'platform': 'zomato', 'res_id': 19519013} 2025-03-12 09:24:21 [reviews] INFO: Scraped item: {'review': 'No salt , qualty degraded. No ricr only gravy', 'review_id': 283258576, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Noida', 'sub_zone': 'Chaukhandi', 'platform': 'zomato', 'res_id': 19519013} 2025-03-12 09:24:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19519013&page=1> {'review': 'No salt , qualty degraded. No ricr only gravy', 'review_id': 283258576, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Noida', 'sub_zone': 'Chaukhandi', 'platform': 'zomato', 'res_id': 19519013} 2025-03-12 09:24:21 [reviews] INFO: Stopping for res_id: 19519013 as reviews are older than 7 days. 2025-03-12 09:24:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:24:28 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:24:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:24:37 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:24:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:24:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:24:44 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19530561, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771420, 'download_latency': 0.7924256324768066, 'depth': 0} 2025-03-12 09:24:44 [reviews] INFO: Scraped item: {'review': 'Very less quantity', 'review_id': 283559762, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19530561} 2025-03-12 09:24:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530561&page=1> {'review': 'Very less quantity', 'review_id': 283559762, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19530561} 2025-03-12 09:24:44 [reviews] INFO: Scraped item: {'review': 'bad taste. food was not fresh.', 'review_id': 283437686, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19530561} 2025-03-12 09:24:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530561&page=1> {'review': 'bad taste. food was not fresh.', 'review_id': 283437686, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19530561} 2025-03-12 09:24:44 [reviews] INFO: Stopping for res_id: 19530561 as reviews are older than 7 days. 2025-03-12 09:24:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:24:48 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771424, 'download_latency': 0.7827444076538086, 'depth': 0} 2025-03-12 09:24:48 [reviews] INFO: Scraped item: {'review': 'Can be better. Not feel original existing test', 'review_id': 284543553, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900} 2025-03-12 09:24:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530900&page=1> {'review': 'Can be better. Not feel original existing test', 'review_id': 284543553, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900} 2025-03-12 09:24:48 [reviews] INFO: Scraped item: {'review': 'Good quality ', 'review_id': 284052368, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900} 2025-03-12 09:24:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530900&page=1> {'review': 'Good quality ', 'review_id': 284052368, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900} 2025-03-12 09:24:48 [reviews] INFO: Scraped item: {'review': 'ok Roll
small roll and stuffing contents for the high price ', 'review_id': 283910112, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900} 2025-03-12 09:24:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530900&page=1> {'review': 'ok Roll
small roll and stuffing contents for the high price ', 'review_id': 283910112, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900} 2025-03-12 09:24:48 [reviews] INFO: Scraped item: {'review': 'Not very cold enough ', 'review_id': 283796981, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900} 2025-03-12 09:24:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530900&page=1> {'review': 'Not very cold enough ', 'review_id': 283796981, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900} 2025-03-12 09:24:48 [reviews] INFO: Scraped item: {'review': 'no mutton in mutton biryani', 'review_id': 283742289, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900} 2025-03-12 09:24:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530900&page=1> {'review': 'no mutton in mutton biryani', 'review_id': 283742289, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900} 2025-03-12 09:24:51 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:24:55 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:24:56 [scrapy.extensions.logstats] INFO: Crawled 118 pages (at 6 pages/min), scraped 386 items (at 16 items/min) 2025-03-12 09:24:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:25:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:25:04 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:25:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:25:12 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771448, 'download_latency': 4.173090934753418, 'depth': 0} 2025-03-12 09:25:12 [reviews] INFO: Scraped item: {'review': 'Leg piece present in biryani was not properly cooked...it felt like it was of yesterday cooked and hard and dry..', 'review_id': 285003686, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041} 2025-03-12 09:25:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531041&page=1> {'review': 'Leg piece present in biryani was not properly cooked...it felt like it was of yesterday cooked and hard and dry..', 'review_id': 285003686, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041} 2025-03-12 09:25:12 [reviews] INFO: Scraped item: {'review': 'briyani was tasting like briyani ', 'review_id': 284492954, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041} 2025-03-12 09:25:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531041&page=1> {'review': 'briyani was tasting like briyani ', 'review_id': 284492954, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041} 2025-03-12 09:25:12 [reviews] INFO: Scraped item: {'review': "Delivery delayed by an hour very bad experience if you don't get delivery in time then food Quality have no sense", 'review_id': 284101941, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041} 2025-03-12 09:25:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531041&page=1> {'review': "Delivery delayed by an hour very bad experience if you don't get delivery in time then food Quality have no sense", 'review_id': 284101941, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041} 2025-03-12 09:25:12 [reviews] INFO: Scraped item: {'review': 'The biryani was gud but the rice quantity is less.', 'review_id': 283899520, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041} 2025-03-12 09:25:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531041&page=1> {'review': 'The biryani was gud but the rice quantity is less.', 'review_id': 283899520, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041} 2025-03-12 09:25:12 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283877827, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041} 2025-03-12 09:25:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531041&page=1> {'review': '', 'review_id': 283877827, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041} 2025-03-12 09:25:12 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:25:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:25:18 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'City Mall', 'platform': 'zomato', 'res_id': 19531051, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771456, 'download_latency': 2.2591750621795654, 'depth': 0} 2025-03-12 09:25:18 [reviews] INFO: Scraped item: {'review': 'one of the best briyani and a lot of chicken the spicy is really good 5 star', 'review_id': 284983215, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'City Mall', 'platform': 'zomato', 'res_id': 19531051} 2025-03-12 09:25:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531051&page=1> {'review': 'one of the best briyani and a lot of chicken the spicy is really good 5 star', 'review_id': 284983215, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'City Mall', 'platform': 'zomato', 'res_id': 19531051} 2025-03-12 09:25:18 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284625824, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'City Mall', 'platform': 'zomato', 'res_id': 19531051} 2025-03-12 09:25:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531051&page=1> {'review': '', 'review_id': 284625824, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'City Mall', 'platform': 'zomato', 'res_id': 19531051} 2025-03-12 09:25:18 [reviews] INFO: Scraped item: {'review': 'bad 👎', 'review_id': 283609264, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'City Mall', 'platform': 'zomato', 'res_id': 19531051} 2025-03-12 09:25:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531051&page=1> {'review': 'bad 👎', 'review_id': 283609264, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'City Mall', 'platform': 'zomato', 'res_id': 19531051} 2025-03-12 09:25:18 [reviews] INFO: Scraped item: {'review': 'should add one extra spoon atleast ', 'review_id': 283591937, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'City Mall', 'platform': 'zomato', 'res_id': 19531051} 2025-03-12 09:25:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531051&page=1> {'review': 'should add one extra spoon atleast ', 'review_id': 283591937, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'City Mall', 'platform': 'zomato', 'res_id': 19531051} 2025-03-12 09:25:18 [reviews] INFO: Stopping for res_id: 19531051 as reviews are older than 7 days. 2025-03-12 09:25:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:25:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:25:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:25:30 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 43, 'brand_name': 'Wok Sushi Bao', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19542350, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771469, 'download_latency': 1.598421335220337, 'depth': 0} 2025-03-12 09:25:30 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284958969, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 43, 'brand_name': 'Wok Sushi Bao', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19542350} 2025-03-12 09:25:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19542350&page=1> {'review': '', 'review_id': 284958969, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 43, 'brand_name': 'Wok Sushi Bao', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19542350} 2025-03-12 09:25:30 [reviews] INFO: Stopping for res_id: 19542350 as reviews are older than 7 days. 2025-03-12 09:25:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:25:35 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:25:38 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:25:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:25:44 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771484, 'download_latency': 1.4228553771972656, 'depth': 0} 2025-03-12 09:25:44 [reviews] INFO: Scraped item: {'review': 'the taste was compromised on the offer one product also the quantity was less for 1 person', 'review_id': 285173917, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894} 2025-03-12 09:25:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19542894&page=1> {'review': 'the taste was compromised on the offer one product also the quantity was less for 1 person', 'review_id': 285173917, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894} 2025-03-12 09:25:44 [reviews] INFO: Scraped item: {'review': 'The chicken in the Biryani was all smelling YUCKS and even the seekh kabab was half cooked and smelling bad.Stale chicken for sure.Never ordering again.', 'review_id': 284513083, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894} 2025-03-12 09:25:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19542894&page=1> {'review': 'The chicken in the Biryani was all smelling YUCKS and even the seekh kabab was half cooked and smelling bad.Stale chicken for sure.Never ordering again.', 'review_id': 284513083, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894} 2025-03-12 09:25:44 [reviews] INFO: Scraped item: {'review': "Kabab were totally uncooked and there were not sticking to stick . Today's biryani was average too . Only potato .", 'review_id': 284470532, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894} 2025-03-12 09:25:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19542894&page=1> {'review': "Kabab were totally uncooked and there were not sticking to stick . Today's biryani was average too . Only potato .", 'review_id': 284470532, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894} 2025-03-12 09:25:44 [reviews] INFO: Scraped item: {'review': 'Biryani was horrible. Chicken piece was roasted/cooked too much. not able to chew it. finally had to throw it.
it seems it was a stale cooked chicken.', 'review_id': 284205902, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894} 2025-03-12 09:25:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19542894&page=1> {'review': 'Biryani was horrible. Chicken piece was roasted/cooked too much. not able to chew it. finally had to throw it.
it seems it was a stale cooked chicken.', 'review_id': 284205902, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894} 2025-03-12 09:25:44 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283801703, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894} 2025-03-12 09:25:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19542894&page=1> {'review': '', 'review_id': 283801703, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894} 2025-03-12 09:25:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:25:48 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Matunga', 'platform': 'zomato', 'res_id': 19548251, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771488, 'download_latency': 1.5687658786773682, 'depth': 0} 2025-03-12 09:25:48 [reviews] INFO: Scraped item: {'review': 'Why so expensive? For this pizza? Its like some other pizza only... i called for it nd i thought it might be something exclusive... but thanks for delivering a normal pizza', 'review_id': 283464341, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Matunga', 'platform': 'zomato', 'res_id': 19548251} 2025-03-12 09:25:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19548251&page=1> {'review': 'Why so expensive? For this pizza? Its like some other pizza only... i called for it nd i thought it might be something exclusive... but thanks for delivering a normal pizza', 'review_id': 283464341, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Matunga', 'platform': 'zomato', 'res_id': 19548251} 2025-03-12 09:25:48 [reviews] INFO: Scraped item: {'review': "the pizza was cold and rock hard like stone. very dissatisfied with the level of service I'm receiving to the amount of money I'm paying", 'review_id': 283391995, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Matunga', 'platform': 'zomato', 'res_id': 19548251} 2025-03-12 09:25:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19548251&page=1> {'review': "the pizza was cold and rock hard like stone. very dissatisfied with the level of service I'm receiving to the amount of money I'm paying", 'review_id': 283391995, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Matunga', 'platform': 'zomato', 'res_id': 19548251} 2025-03-12 09:25:48 [reviews] INFO: Scraped item: {'review': 'The size of cake was less than a pastry', 'review_id': 283254461, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Matunga', 'platform': 'zomato', 'res_id': 19548251} 2025-03-12 09:25:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19548251&page=1> {'review': 'The size of cake was less than a pastry', 'review_id': 283254461, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Matunga', 'platform': 'zomato', 'res_id': 19548251} 2025-03-12 09:25:48 [reviews] INFO: Stopping for res_id: 19548251 as reviews are older than 7 days. 2025-03-12 09:25:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:25:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:25:56 [scrapy.extensions.logstats] INFO: Crawled 123 pages (at 5 pages/min), scraped 404 items (at 18 items/min) 2025-03-12 09:25:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:26:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:26:06 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:26:10 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:26:13 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:26:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:26:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:26:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:26:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:26:31 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19548739, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771530, 'download_latency': 2.6798245906829834, 'depth': 0} 2025-03-12 09:26:31 [reviews] INFO: Stopping for res_id: 19548739 as reviews are older than 7 days. 2025-03-12 09:26:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:26:36 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:26:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:26:41 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Juhu', 'platform': 'zomato', 'res_id': 19559682, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771539, 'download_latency': 1.5503597259521484, 'depth': 0} 2025-03-12 09:26:41 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284521559, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Juhu', 'platform': 'zomato', 'res_id': 19559682} 2025-03-12 09:26:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19559682&page=1> {'review': '', 'review_id': 284521559, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Juhu', 'platform': 'zomato', 'res_id': 19559682} 2025-03-12 09:26:41 [reviews] INFO: Scraped item: {'review': 'na', 'review_id': 283973123, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Juhu', 'platform': 'zomato', 'res_id': 19559682} 2025-03-12 09:26:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19559682&page=1> {'review': 'na', 'review_id': 283973123, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Juhu', 'platform': 'zomato', 'res_id': 19559682} 2025-03-12 09:26:41 [reviews] INFO: Stopping for res_id: 19559682 as reviews are older than 7 days. 2025-03-12 09:26:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:26:44 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771544, 'download_latency': 1.6394016742706299, 'depth': 0} 2025-03-12 09:26:44 [reviews] INFO: Scraped item: {'review': 'worst Biryani ever had, leg peice which is completely Dried out no taste just boiled rice.', 'review_id': 285198909, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464} 2025-03-12 09:26:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19562464&page=1> {'review': 'worst Biryani ever had, leg peice which is completely Dried out no taste just boiled rice.', 'review_id': 285198909, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464} 2025-03-12 09:26:44 [reviews] INFO: Scraped item: {'review': 'in paneer biryani served there was only counted 4 paneer pieces as per price charged request for more pieces of paneer', 'review_id': 284972726, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464} 2025-03-12 09:26:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19562464&page=1> {'review': 'in paneer biryani served there was only counted 4 paneer pieces as per price charged request for more pieces of paneer', 'review_id': 284972726, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464} 2025-03-12 09:26:44 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284872757, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464} 2025-03-12 09:26:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19562464&page=1> {'review': '', 'review_id': 284872757, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464} 2025-03-12 09:26:44 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284614489, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464} 2025-03-12 09:26:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19562464&page=1> {'review': '', 'review_id': 284614489, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464} 2025-03-12 09:26:44 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283497985, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464} 2025-03-12 09:26:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19562464&page=1> {'review': '', 'review_id': 283497985, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464} 2025-03-12 09:26:45 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:26:48 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:26:51 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:26:55 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:26:56 [scrapy.extensions.logstats] INFO: Crawled 126 pages (at 3 pages/min), scraped 411 items (at 7 items/min) 2025-03-12 09:26:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:27:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:27:06 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:27:09 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:27:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:27:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:27:20 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:27:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:27:26 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19566888, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771591, 'download_latency': 2.0387487411499023, 'depth': 0} 2025-03-12 09:27:26 [reviews] INFO: Stopping for res_id: 19566888 as reviews are older than 7 days. 2025-03-12 09:27:26 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:27:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:27:31 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771596, 'download_latency': 0.9755446910858154, 'depth': 0} 2025-03-12 09:27:31 [reviews] INFO: Scraped item: {'review': 'Less food portion', 'review_id': 285265291, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-12', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166} 2025-03-12 09:27:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19570166&page=1> {'review': 'Less food portion', 'review_id': 285265291, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-12', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166} 2025-03-12 09:27:31 [reviews] INFO: Scraped item: {'review': '', 'review_id': 285193875, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166} 2025-03-12 09:27:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19570166&page=1> {'review': '', 'review_id': 285193875, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166} 2025-03-12 09:27:31 [reviews] INFO: Scraped item: {'review': "Today's Biriyani is not good at all. It's very spicy and no salt in it guys. What happened to you?", 'review_id': 285173521, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166} 2025-03-12 09:27:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19570166&page=1> {'review': "Today's Biriyani is not good at all. It's very spicy and no salt in it guys. What happened to you?", 'review_id': 285173521, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166} 2025-03-12 09:27:31 [reviews] INFO: Scraped item: {'review': '', 'review_id': 285139302, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166} 2025-03-12 09:27:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19570166&page=1> {'review': '', 'review_id': 285139302, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166} 2025-03-12 09:27:31 [reviews] INFO: Scraped item: {'review': 'Boneless was too much spicy', 'review_id': 284875838, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166} 2025-03-12 09:27:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19570166&page=1> {'review': 'Boneless was too much spicy', 'review_id': 284875838, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166} 2025-03-12 09:27:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:27:35 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 82, 'brand_name': 'Sesami Asian Kitchen Bar', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19590530, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771602, 'download_latency': 1.3193321228027344, 'depth': 0} 2025-03-12 09:27:35 [reviews] INFO: Scraped item: {'review': 'this place always gets it right! from food to ambience to the service, exceptional
', 'review_id': 284859456, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 82, 'brand_name': 'Sesami Asian Kitchen Bar', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19590530} 2025-03-12 09:27:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19590530&page=1> {'review': 'this place always gets it right! from food to ambience to the service, exceptional
', 'review_id': 284859456, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 82, 'brand_name': 'Sesami Asian Kitchen Bar', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19590530} 2025-03-12 09:27:35 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284657904, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 82, 'brand_name': 'Sesami Asian Kitchen Bar', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19590530} 2025-03-12 09:27:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19590530&page=1> {'review': '', 'review_id': 284657904, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 82, 'brand_name': 'Sesami Asian Kitchen Bar', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19590530} 2025-03-12 09:27:35 [reviews] INFO: Scraped item: {'review': 'Stir fried chicken way too salty.', 'review_id': 284473390, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 82, 'brand_name': 'Sesami Asian Kitchen Bar', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19590530} 2025-03-12 09:27:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19590530&page=1> {'review': 'Stir fried chicken way too salty.', 'review_id': 284473390, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 82, 'brand_name': 'Sesami Asian Kitchen Bar', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19590530} 2025-03-12 09:27:35 [reviews] INFO: Scraped item: {'review': 'Sooraj the best guy', 'review_id': 284363113, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 82, 'brand_name': 'Sesami Asian Kitchen Bar', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19590530} 2025-03-12 09:27:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19590530&page=1> {'review': 'Sooraj the best guy', 'review_id': 284363113, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 82, 'brand_name': 'Sesami Asian Kitchen Bar', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19590530} 2025-03-12 09:27:35 [reviews] INFO: Scraped item: {'review': 'Package leaking!', 'review_id': 283971751, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 82, 'brand_name': 'Sesami Asian Kitchen Bar', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19590530} 2025-03-12 09:27:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19590530&page=1> {'review': 'Package leaking!', 'review_id': 283971751, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 82, 'brand_name': 'Sesami Asian Kitchen Bar', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19590530} 2025-03-12 09:27:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:27:39 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 11, 'brand_name': 'Royal China', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19592218, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771604, 'download_latency': 0.9122867584228516, 'depth': 0} 2025-03-12 09:27:39 [reviews] INFO: Scraped item: {'review': 'One of the best chinese food I had. Extremely tasty, not greasy at all, and fresh tender chicken.', 'review_id': 285150920, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 11, 'brand_name': 'Royal China', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19592218} 2025-03-12 09:27:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19592218&page=1> {'review': 'One of the best chinese food I had. Extremely tasty, not greasy at all, and fresh tender chicken.', 'review_id': 285150920, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 11, 'brand_name': 'Royal China', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19592218} 2025-03-12 09:27:39 [reviews] INFO: Scraped item: {'review': 'I had requested them not to put mushrooms and to use less salt. Both requests were not followed.', 'review_id': 284972227, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 11, 'brand_name': 'Royal China', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19592218} 2025-03-12 09:27:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19592218&page=1> {'review': 'I had requested them not to put mushrooms and to use less salt. Both requests were not followed.', 'review_id': 284972227, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 11, 'brand_name': 'Royal China', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19592218} 2025-03-12 09:27:39 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284971425, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 11, 'brand_name': 'Royal China', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19592218} 2025-03-12 09:27:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19592218&page=1> {'review': '', 'review_id': 284971425, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 11, 'brand_name': 'Royal China', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19592218} 2025-03-12 09:27:39 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284372449, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 11, 'brand_name': 'Royal China', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19592218} 2025-03-12 09:27:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19592218&page=1> {'review': '', 'review_id': 284372449, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 11, 'brand_name': 'Royal China', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19592218} 2025-03-12 09:27:39 [reviews] INFO: Scraped item: {'review': 'Taste average and RC brand over hyped as always. Filled with peanuts.', 'review_id': 283968118, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 11, 'brand_name': 'Royal China', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19592218} 2025-03-12 09:27:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19592218&page=1> {'review': 'Taste average and RC brand over hyped as always. Filled with peanuts.', 'review_id': 283968118, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 11, 'brand_name': 'Royal China', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19592218} 2025-03-12 09:27:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:27:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:27:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:27:52 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:27:56 [scrapy.extensions.logstats] INFO: Crawled 130 pages (at 4 pages/min), scraped 426 items (at 15 items/min) 2025-03-12 09:27:56 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:28:01 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:28:05 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:28:09 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:28:11 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:28:15 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:28:18 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:28:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:28:23 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771646, 'download_latency': 1.3528759479522705, 'depth': 0} 2025-03-12 09:28:23 [reviews] INFO: Scraped item: {'review': 'Food was not good. also 475 ml ordered. received 300 ml cold drink.', 'review_id': 284129439, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926} 2025-03-12 09:28:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19644926&page=1> {'review': 'Food was not good. also 475 ml ordered. received 300 ml cold drink.', 'review_id': 284129439, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926} 2025-03-12 09:28:23 [reviews] INFO: Scraped item: {'review': 'It was tasty but spicy!', 'review_id': 283466731, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926} 2025-03-12 09:28:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19644926&page=1> {'review': 'It was tasty but spicy!', 'review_id': 283466731, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926} 2025-03-12 09:28:23 [reviews] INFO: Scraped item: {'review': 'bhai yaha khane se acha mat khao please bhai veggies fresh the and rice pura sadd gya tha and noodle is like ehhhhw thats my opinion please take care of your health ', 'review_id': 283463668, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926} 2025-03-12 09:28:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19644926&page=1> {'review': 'bhai yaha khane se acha mat khao please bhai veggies fresh the and rice pura sadd gya tha and noodle is like ehhhhw thats my opinion please take care of your health ', 'review_id': 283463668, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926} 2025-03-12 09:28:23 [reviews] INFO: Stopping for res_id: 19644926 as reviews are older than 7 days. 2025-03-12 09:28:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:28:26 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771647, 'download_latency': 1.009584665298462, 'depth': 0} 2025-03-12 09:28:26 [reviews] INFO: Scraped item: {'review': 'quantity is less that what you get when you done in', 'review_id': 285082258, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023} 2025-03-12 09:28:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19645023&page=1> {'review': 'quantity is less that what you get when you done in', 'review_id': 285082258, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023} 2025-03-12 09:28:26 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284851427, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023} 2025-03-12 09:28:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19645023&page=1> {'review': '', 'review_id': 284851427, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023} 2025-03-12 09:28:26 [reviews] INFO: Scraped item: {'review': 'Cold food,', 'review_id': 284768286, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023} 2025-03-12 09:28:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19645023&page=1> {'review': 'Cold food,', 'review_id': 284768286, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023} 2025-03-12 09:28:26 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284601294, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023} 2025-03-12 09:28:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19645023&page=1> {'review': '', 'review_id': 284601294, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023} 2025-03-12 09:28:26 [reviews] INFO: Scraped item: {'review': 'The taste of noodles was not as good as served in restaurant. Home delivery food is not fresh and well made', 'review_id': 284051074, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023} 2025-03-12 09:28:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19645023&page=1> {'review': 'The taste of noodles was not as good as served in restaurant. Home delivery food is not fresh and well made', 'review_id': 284051074, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023} 2025-03-12 09:28:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:28:29 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 68, 'brand_name': 'Fat Monk Chinese', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 19646158, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771652, 'download_latency': 1.0752191543579102, 'depth': 0} 2025-03-12 09:28:29 [reviews] INFO: Scraped item: {'review': 'noodles quantity was very less as per the price that you charge ', 'review_id': 285137556, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 68, 'brand_name': 'Fat Monk Chinese', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 19646158} 2025-03-12 09:28:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19646158&page=1> {'review': 'noodles quantity was very less as per the price that you charge ', 'review_id': 285137556, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 68, 'brand_name': 'Fat Monk Chinese', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 19646158} 2025-03-12 09:28:29 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283258473, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 68, 'brand_name': 'Fat Monk Chinese', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 19646158} 2025-03-12 09:28:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19646158&page=1> {'review': '', 'review_id': 283258473, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 68, 'brand_name': 'Fat Monk Chinese', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 19646158} 2025-03-12 09:28:29 [reviews] INFO: Stopping for res_id: 19646158 as reviews are older than 7 days. 2025-03-12 09:28:31 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:28:34 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:28:38 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:28:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:28:45 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:28:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:28:53 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:28:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-12 09:28:57 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-12 09:28:57 [scrapy.extensions.logstats] INFO: Crawled 133 pages (at 3 pages/min), scraped 436 items (at 10 items/min) 2025-03-12 09:28:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:29:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:29:05 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:29:09 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:29:13 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:29:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:29:18 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Kandivali', 'platform': 'zomato', 'res_id': 19692864, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771698, 'download_latency': 1.1826145648956299, 'depth': 0} 2025-03-12 09:29:18 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284422655, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Kandivali', 'platform': 'zomato', 'res_id': 19692864} 2025-03-12 09:29:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19692864&page=1> {'review': '', 'review_id': 284422655, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Kandivali', 'platform': 'zomato', 'res_id': 19692864} 2025-03-12 09:29:18 [reviews] INFO: Scraped item: {'review': "didn't like it", 'review_id': 284377318, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Kandivali', 'platform': 'zomato', 'res_id': 19692864} 2025-03-12 09:29:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19692864&page=1> {'review': "didn't like it", 'review_id': 284377318, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Kandivali', 'platform': 'zomato', 'res_id': 19692864} 2025-03-12 09:29:18 [reviews] INFO: Stopping for res_id: 19692864 as reviews are older than 7 days. 2025-03-12 09:29:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:29:20 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771703, 'download_latency': 0.8890066146850586, 'depth': 0} 2025-03-12 09:29:20 [reviews] INFO: Scraped item: {'review': 'Amazing food', 'review_id': 285169794, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667} 2025-03-12 09:29:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19709667&page=1> {'review': 'Amazing food', 'review_id': 285169794, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667} 2025-03-12 09:29:20 [reviews] INFO: Scraped item: {'review': 'good', 'review_id': 285162626, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667} 2025-03-12 09:29:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19709667&page=1> {'review': 'good', 'review_id': 285162626, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667} 2025-03-12 09:29:20 [reviews] INFO: Scraped item: {'review': 'very good place', 'review_id': 285138688, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667} 2025-03-12 09:29:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19709667&page=1> {'review': 'very good place', 'review_id': 285138688, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667} 2025-03-12 09:29:20 [reviews] INFO: Scraped item: {'review': 'Randheer', 'review_id': 285011767, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667} 2025-03-12 09:29:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19709667&page=1> {'review': 'Randheer', 'review_id': 285011767, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667} 2025-03-12 09:29:20 [reviews] INFO: Scraped item: {'review': 'Amazing food!', 'review_id': 284839296, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667} 2025-03-12 09:29:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19709667&page=1> {'review': 'Amazing food!', 'review_id': 284839296, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667} 2025-03-12 09:29:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:29:27 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771706, 'download_latency': 2.666104316711426, 'depth': 0} 2025-03-12 09:29:27 [reviews] INFO: Scraped item: {'review': 'rice was completely uncooked and dry', 'review_id': 285256823, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-12', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214} 2025-03-12 09:29:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19745214&page=1> {'review': 'rice was completely uncooked and dry', 'review_id': 285256823, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-12', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214} 2025-03-12 09:29:27 [reviews] INFO: Scraped item: {'review': 'Worst taste local Chinese is 100 times better', 'review_id': 285201911, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214} 2025-03-12 09:29:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19745214&page=1> {'review': 'Worst taste local Chinese is 100 times better', 'review_id': 285201911, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214} 2025-03-12 09:29:27 [reviews] INFO: Scraped item: {'review': 'the food is so good 👍👍', 'review_id': 285109753, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214} 2025-03-12 09:29:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19745214&page=1> {'review': 'the food is so good 👍👍', 'review_id': 285109753, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214} 2025-03-12 09:29:27 [reviews] INFO: Scraped item: {'review': 'terrible food', 'review_id': 285038959, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214} 2025-03-12 09:29:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19745214&page=1> {'review': 'terrible food', 'review_id': 285038959, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214} 2025-03-12 09:29:27 [reviews] INFO: Scraped item: {'review': 'Worst noodles ever i ate', 'review_id': 284140621, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214} 2025-03-12 09:29:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19745214&page=1> {'review': 'Worst noodles ever i ate', 'review_id': 284140621, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214} 2025-03-12 09:29:28 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:29:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:29:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:29:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:29:43 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:29:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:29:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:29:54 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:29:56 [scrapy.extensions.logstats] INFO: Crawled 136 pages (at 3 pages/min), scraped 448 items (at 12 items/min) 2025-03-12 09:29:58 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:30:02 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:30:05 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:30:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:30:09 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 3, 'brand_name': 'Art Of Dum', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 19769266, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771749, 'download_latency': 0.6881661415100098, 'depth': 0} 2025-03-12 09:30:09 [reviews] INFO: Scraped item: {'review': 'woow', 'review_id': 284901238, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 3, 'brand_name': 'Art Of Dum', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 19769266} 2025-03-12 09:30:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19769266&page=1> {'review': 'woow', 'review_id': 284901238, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 3, 'brand_name': 'Art Of Dum', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 19769266} 2025-03-12 09:30:09 [reviews] INFO: Scraped item: {'review': "The Raita and salan with 2 biryanis (900gm each) was severely insufficient!
This is a constant concern with this eatery!
3 small bottles of raita and salan with almost 2kg biryani... Doesn't make any sense.", 'review_id': 283734090, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 3, 'brand_name': 'Art Of Dum', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 19769266} 2025-03-12 09:30:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19769266&page=1> {'review': "The Raita and salan with 2 biryanis (900gm each) was severely insufficient!
This is a constant concern with this eatery!
3 small bottles of raita and salan with almost 2kg biryani... Doesn't make any sense.", 'review_id': 283734090, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 3, 'brand_name': 'Art Of Dum', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 19769266} 2025-03-12 09:30:09 [reviews] INFO: Stopping for res_id: 19769266 as reviews are older than 7 days. 2025-03-12 09:30:11 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:30:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:30:16 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19824933, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771758, 'download_latency': 0.7319188117980957, 'depth': 0} 2025-03-12 09:30:16 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283401028, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19824933} 2025-03-12 09:30:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19824933&page=1> {'review': '', 'review_id': 283401028, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19824933} 2025-03-12 09:30:16 [reviews] INFO: Stopping for res_id: 19824933 as reviews are older than 7 days. 2025-03-12 09:30:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:30:20 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771761, 'download_latency': 0.7202816009521484, 'depth': 0} 2025-03-12 09:30:20 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284992997, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717} 2025-03-12 09:30:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19832717&page=1> {'review': '', 'review_id': 284992997, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717} 2025-03-12 09:30:20 [reviews] INFO: Scraped item: {'review': 'tasty food with good quality ,🙌🏻', 'review_id': 284705849, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-10', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717} 2025-03-12 09:30:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19832717&page=1> {'review': 'tasty food with good quality ,🙌🏻', 'review_id': 284705849, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-10', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717} 2025-03-12 09:30:20 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284359540, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717} 2025-03-12 09:30:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19832717&page=1> {'review': '', 'review_id': 284359540, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717} 2025-03-12 09:30:20 [reviews] INFO: Scraped item: {'review': 'undercooked and salty food', 'review_id': 284079973, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717} 2025-03-12 09:30:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19832717&page=1> {'review': 'undercooked and salty food', 'review_id': 284079973, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717} 2025-03-12 09:30:20 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283749803, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717} 2025-03-12 09:30:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19832717&page=1> {'review': '', 'review_id': 283749803, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717} 2025-03-12 09:30:23 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:30:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:30:31 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:30:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:30:39 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:30:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:30:45 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:30:48 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:30:52 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:30:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:30:56 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19845961, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771799, 'download_latency': 0.6777799129486084, 'depth': 0} 2025-03-12 09:30:56 [reviews] INFO: Scraped item: {'review': 'The Amount of Chicken in the Biryani was very less. Overall taste was Ok 👍. ', 'review_id': 285060152, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19845961} 2025-03-12 09:30:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19845961&page=1> {'review': 'The Amount of Chicken in the Biryani was very less. Overall taste was Ok 👍. ', 'review_id': 285060152, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19845961} 2025-03-12 09:30:56 [reviews] INFO: Scraped item: {'review': "the gulab jamun was worst can't even eat threw it in dustbin very very bad", 'review_id': 284959545, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19845961} 2025-03-12 09:30:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19845961&page=1> {'review': "the gulab jamun was worst can't even eat threw it in dustbin very very bad", 'review_id': 284959545, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19845961} 2025-03-12 09:30:56 [reviews] INFO: Scraped item: {'review': 'soya chaap biryani was amazing from biryani by kilo ❤️', 'review_id': 283818199, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19845961} 2025-03-12 09:30:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19845961&page=1> {'review': 'soya chaap biryani was amazing from biryani by kilo ❤️', 'review_id': 283818199, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19845961} 2025-03-12 09:30:56 [reviews] INFO: Stopping for res_id: 19845961 as reviews are older than 7 days. 2025-03-12 09:30:56 [scrapy.extensions.logstats] INFO: Crawled 140 pages (at 4 pages/min), scraped 459 items (at 11 items/min) 2025-03-12 09:30:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:30:59 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'MumbaiMumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 19855416, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771802, 'download_latency': 0.6715266704559326, 'depth': 0} 2025-03-12 09:30:59 [reviews] INFO: Scraped item: {'review': 'pizza slices were smashed inside the box', 'review_id': 285215278, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'MumbaiMumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 19855416} 2025-03-12 09:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19855416&page=1> {'review': 'pizza slices were smashed inside the box', 'review_id': 285215278, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'MumbaiMumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 19855416} 2025-03-12 09:30:59 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284576917, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'MumbaiMumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 19855416} 2025-03-12 09:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19855416&page=1> {'review': '', 'review_id': 284576917, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'MumbaiMumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 19855416} 2025-03-12 09:30:59 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284524548, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'MumbaiMumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 19855416} 2025-03-12 09:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19855416&page=1> {'review': '', 'review_id': 284524548, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'MumbaiMumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 19855416} 2025-03-12 09:30:59 [reviews] INFO: Scraped item: {'review': 'Very bad', 'review_id': 283561250, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'MumbaiMumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 19855416} 2025-03-12 09:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19855416&page=1> {'review': 'Very bad', 'review_id': 283561250, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'MumbaiMumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 19855416} 2025-03-12 09:30:59 [reviews] INFO: Stopping for res_id: 19855416 as reviews are older than 7 days. 2025-03-12 09:31:01 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:31:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:31:05 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771809, 'download_latency': 0.706265926361084, 'depth': 0} 2025-03-12 09:31:05 [reviews] INFO: Scraped item: {'review': '', 'review_id': 285176195, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363} 2025-03-12 09:31:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19856363&page=1> {'review': '', 'review_id': 285176195, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363} 2025-03-12 09:31:05 [reviews] INFO: Scraped item: {'review': 'Quantity was less', 'review_id': 285169349, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363} 2025-03-12 09:31:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19856363&page=1> {'review': 'Quantity was less', 'review_id': 285169349, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363} 2025-03-12 09:31:05 [reviews] INFO: Scraped item: {'review': 'Though ingredients quality is good but food was Tasteless. Schezwan sauce is just like chilli sauce. Chicken schezwan fried rice had a very small amount of chicken pieces. Hunan chicken was ok.', 'review_id': 284942952, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363} 2025-03-12 09:31:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19856363&page=1> {'review': 'Though ingredients quality is good but food was Tasteless. Schezwan sauce is just like chilli sauce. Chicken schezwan fried rice had a very small amount of chicken pieces. Hunan chicken was ok.', 'review_id': 284942952, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363} 2025-03-12 09:31:05 [reviews] INFO: Scraped item: {'review': 'awesome packing awesome taste', 'review_id': 284868467, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363} 2025-03-12 09:31:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19856363&page=1> {'review': 'awesome packing awesome taste', 'review_id': 284868467, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363} 2025-03-12 09:31:05 [reviews] INFO: Scraped item: {'review': 'food was too spicy and did not taste good. we had to throw away a substantial portion ', 'review_id': 284632359, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363} 2025-03-12 09:31:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19856363&page=1> {'review': 'food was too spicy and did not taste good. we had to throw away a substantial portion ', 'review_id': 284632359, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363} 2025-03-12 09:31:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:31:09 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771812, 'download_latency': 0.7611241340637207, 'depth': 0} 2025-03-12 09:31:09 [reviews] INFO: Scraped item: {'review': 'Really good food', 'review_id': 285241690, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-12', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306} 2025-03-12 09:31:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19894306&page=1> {'review': 'Really good food', 'review_id': 285241690, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-12', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306} 2025-03-12 09:31:09 [reviews] INFO: Scraped item: {'review': "The biryani I ordered was ridiculously spicy to the point where it’s now causing discomfort and irritation in my body. It wasn’t just “spicy for flavor” — it felt like a mouthful of raw chili powder. The heat was so overpowering that it completely ruined the taste, and now I'm left feeling uneasy. Definitely not what I expected or signed up for. Really disappointed!

", 'review_id': 285202673, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306} 2025-03-12 09:31:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19894306&page=1> {'review': "The biryani I ordered was ridiculously spicy to the point where it’s now causing discomfort and irritation in my body. It wasn’t just “spicy for flavor” — it felt like a mouthful of raw chili powder. The heat was so overpowering that it completely ruined the taste, and now I'm left feeling uneasy. Definitely not what I expected or signed up for. Really disappointed!

", 'review_id': 285202673, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306} 2025-03-12 09:31:09 [reviews] INFO: Scraped item: {'review': 'But no salan was provided', 'review_id': 284723278, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306} 2025-03-12 09:31:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19894306&page=1> {'review': 'But no salan was provided', 'review_id': 284723278, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306} 2025-03-12 09:31:09 [reviews] INFO: Scraped item: {'review': 'wrong item send ', 'review_id': 284582231, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306} 2025-03-12 09:31:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19894306&page=1> {'review': 'wrong item send ', 'review_id': 284582231, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306} 2025-03-12 09:31:09 [reviews] INFO: Scraped item: {'review': 'just go for this biriyani finally found a Kolkata style proper dum biryani ', 'review_id': 284545970, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306} 2025-03-12 09:31:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19894306&page=1> {'review': 'just go for this biriyani finally found a Kolkata style proper dum biryani ', 'review_id': 284545970, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306} 2025-03-12 09:31:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:31:13 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771817, 'download_latency': 0.7589194774627686, 'depth': 0} 2025-03-12 09:31:13 [reviews] INFO: Scraped item: {'review': "It's a double friend and the taste is not good , all kachori are Red ", 'review_id': 284683699, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697} 2025-03-12 09:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19931697&page=1> {'review': "It's a double friend and the taste is not good , all kachori are Red ", 'review_id': 284683699, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697} 2025-03-12 09:31:13 [reviews] INFO: Scraped item: {'review': 'The size of the ghevar has been reduced drastically and the richness of the dish has gone down. I was a huge fan, felt disappointed for the first time.', 'review_id': 284330402, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697} 2025-03-12 09:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19931697&page=1> {'review': 'The size of the ghevar has been reduced drastically and the richness of the dish has gone down. I was a huge fan, felt disappointed for the first time.', 'review_id': 284330402, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697} 2025-03-12 09:31:13 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284102980, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697} 2025-03-12 09:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19931697&page=1> {'review': '', 'review_id': 284102980, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697} 2025-03-12 09:31:13 [reviews] INFO: Scraped item: {'review': 'not worth it', 'review_id': 283510040, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697} 2025-03-12 09:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19931697&page=1> {'review': 'not worth it', 'review_id': 283510040, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697} 2025-03-12 09:31:13 [reviews] INFO: Scraped item: {'review': 'Ramzan gifting just got more special. Meetha by Radisson has come up with a Ramzan gifting hamper that is sure to wow your friends and family. Not only does it spell luxury in every way, it also contains your classic Ramzan items - Falooda, Firni, an assortment of sweets, Farsan, Malpua and my favourite from this: the Laccha Rabdi. So be it corporate gifting or sending love for friends and family, this is the Ramzan hamper you must check out!', 'review_id': 283232659, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-06', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697} 2025-03-12 09:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19931697&page=1> {'review': 'Ramzan gifting just got more special. Meetha by Radisson has come up with a Ramzan gifting hamper that is sure to wow your friends and family. Not only does it spell luxury in every way, it also contains your classic Ramzan items - Falooda, Firni, an assortment of sweets, Farsan, Malpua and my favourite from this: the Laccha Rabdi. So be it corporate gifting or sending love for friends and family, this is the Ramzan hamper you must check out!', 'review_id': 283232659, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-06', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697} 2025-03-12 09:31:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:31:16 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771820, 'download_latency': 0.7084887027740479, 'depth': 0} 2025-03-12 09:31:16 [reviews] INFO: Scraped item: {'review': 'they put potato instaed of soya chap', 'review_id': 284687058, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341} 2025-03-12 09:31:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20020341&page=1> {'review': 'they put potato instaed of soya chap', 'review_id': 284687058, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341} 2025-03-12 09:31:16 [reviews] INFO: Scraped item: {'review': 'Worst biryani ever.....seems like boiled rice instead tasted veryyyyy badddd i want refund of this', 'review_id': 284566070, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341} 2025-03-12 09:31:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20020341&page=1> {'review': 'Worst biryani ever.....seems like boiled rice instead tasted veryyyyy badddd i want refund of this', 'review_id': 284566070, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341} 2025-03-12 09:31:16 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284158072, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341} 2025-03-12 09:31:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20020341&page=1> {'review': '', 'review_id': 284158072, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341} 2025-03-12 09:31:16 [reviews] INFO: Scraped item: {'review': 'Didnt send cutlery when in the adress i clearly mentioned hotel......had to blinket extra cutlery.', 'review_id': 284155392, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341} 2025-03-12 09:31:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20020341&page=1> {'review': 'Didnt send cutlery when in the adress i clearly mentioned hotel......had to blinket extra cutlery.', 'review_id': 284155392, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341} 2025-03-12 09:31:16 [reviews] INFO: Scraped item: {'review': 'It tastes delicious with good packaging but the quantity is not much as per the price.', 'review_id': 284145497, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341} 2025-03-12 09:31:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20020341&page=1> {'review': 'It tastes delicious with good packaging but the quantity is not much as per the price.', 'review_id': 284145497, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341} 2025-03-12 09:31:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:31:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:31:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:31:31 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:31:34 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:31:37 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:31:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:31:44 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:31:48 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:31:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:31:53 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 36, 'brand_name': 'Slay Coffee Bar', 'city': 'Bangalore', 'sub_zone': 'RMZ Millenia', 'platform': 'zomato', 'res_id': 20086621, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771856, 'download_latency': 1.608412265777588, 'depth': 0} 2025-03-12 09:31:53 [reviews] INFO: Stopping for res_id: 20086621 as reviews are older than 7 days. 2025-03-12 09:31:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:31:56 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 26, 'brand_name': 'Starbucks Coffee', 'city': 'Bangalore', 'sub_zone': 'Garuda Mall', 'platform': 'zomato', 'res_id': 20214336, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771859, 'download_latency': 0.6982908248901367, 'depth': 0} 2025-03-12 09:31:56 [reviews] INFO: Scraped item: {'review': 'very good', 'review_id': 285268404, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-12', 'competitor_id': 26, 'brand_name': 'Starbucks Coffee', 'city': 'Bangalore', 'sub_zone': 'Garuda Mall', 'platform': 'zomato', 'res_id': 20214336} 2025-03-12 09:31:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20214336&page=1> {'review': 'very good', 'review_id': 285268404, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-12', 'competitor_id': 26, 'brand_name': 'Starbucks Coffee', 'city': 'Bangalore', 'sub_zone': 'Garuda Mall', 'platform': 'zomato', 'res_id': 20214336} 2025-03-12 09:31:56 [reviews] INFO: Stopping for res_id: 20214336 as reviews are older than 7 days. 2025-03-12 09:31:56 [scrapy.extensions.logstats] INFO: Crawled 147 pages (at 7 pages/min), scraped 484 items (at 25 items/min) 2025-03-12 09:31:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:32:00 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 20227195, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771861, 'download_latency': 0.7007472515106201, 'depth': 0} 2025-03-12 09:32:00 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284762182, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 20227195} 2025-03-12 09:32:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20227195&page=1> {'review': '', 'review_id': 284762182, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 20227195} 2025-03-12 09:32:00 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284361334, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 20227195} 2025-03-12 09:32:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20227195&page=1> {'review': '', 'review_id': 284361334, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 20227195} 2025-03-12 09:32:00 [reviews] INFO: Stopping for res_id: 20227195 as reviews are older than 7 days. 2025-03-12 09:32:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:32:03 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Vikhroli', 'platform': 'zomato', 'res_id': 20248171, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771865, 'download_latency': 0.9677948951721191, 'depth': 0} 2025-03-12 09:32:03 [reviews] ERROR: Unrecognized relative_date format: aug 27, 2023 2025-03-12 09:32:03 [reviews] INFO: Stopping for res_id: 20248171 due to unrecognized date format: Aug 27, 2023. 2025-03-12 09:32:05 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:32:08 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:32:13 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:32:15 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:32:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:32:21 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:32:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:32:28 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:32:31 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:32:34 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:32:37 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:32:40 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:32:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:32:44 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 32, 'brand_name': 'Third Wave Coffee', 'city': 'Bangalore', 'sub_zone': 'Lavelle Road', 'platform': 'zomato', 'res_id': 20265082, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771913, 'download_latency': 0.8114988803863525, 'depth': 0} 2025-03-12 09:32:44 [reviews] INFO: Stopping for res_id: 20265082 as reviews are older than 7 days. 2025-03-12 09:32:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:32:48 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 20267173, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771916, 'download_latency': 0.7284672260284424, 'depth': 0} 2025-03-12 09:32:48 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284265828, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 20267173} 2025-03-12 09:32:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20267173&page=1> {'review': '', 'review_id': 284265828, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 20267173} 2025-03-12 09:32:48 [reviews] INFO: Stopping for res_id: 20267173 as reviews are older than 7 days. 2025-03-12 09:32:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:32:52 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'FUNREPUBLIC MALL', 'platform': 'zomato', 'res_id': 20284206, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771920, 'download_latency': 0.7329871654510498, 'depth': 0} 2025-03-12 09:32:52 [reviews] ERROR: Error parsing date: an hour ago, error: unsupported type for timedelta hours component: NoneType 2025-03-12 09:32:52 [reviews] INFO: Stopping for res_id: 20284206 due to unrecognized date format: an hour ago. 2025-03-12 09:32:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:32:56 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Palladium Mall (Lower Parel)', 'platform': 'zomato', 'res_id': 20340568, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771924, 'download_latency': 0.7779989242553711, 'depth': 0} 2025-03-12 09:32:56 [reviews] INFO: Scraped item: {'review': 'really food was very bad ', 'review_id': 283796133, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Palladium Mall (Lower Parel)', 'platform': 'zomato', 'res_id': 20340568} 2025-03-12 09:32:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20340568&page=1> {'review': 'really food was very bad ', 'review_id': 283796133, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Palladium Mall (Lower Parel)', 'platform': 'zomato', 'res_id': 20340568} 2025-03-12 09:32:56 [reviews] INFO: Scraped item: {'review': 'Worst food and service at this outlet', 'review_id': 283703036, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Palladium Mall (Lower Parel)', 'platform': 'zomato', 'res_id': 20340568} 2025-03-12 09:32:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20340568&page=1> {'review': 'Worst food and service at this outlet', 'review_id': 283703036, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Palladium Mall (Lower Parel)', 'platform': 'zomato', 'res_id': 20340568} 2025-03-12 09:32:56 [reviews] INFO: Stopping for res_id: 20340568 as reviews are older than 7 days. 2025-03-12 09:32:56 [scrapy.extensions.logstats] INFO: Crawled 153 pages (at 6 pages/min), scraped 489 items (at 5 items/min) 2025-03-12 09:32:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:33:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:33:03 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:33:08 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:33:12 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:33:17 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:33:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:33:23 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:33:25 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:33:28 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:33:31 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:33:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:33:35 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771960, 'download_latency': 0.7900631427764893, 'depth': 0} 2025-03-12 09:33:35 [reviews] INFO: Scraped item: {'review': 'Biryani was good, pepper mushroom was very very oily not even edible', 'review_id': 285248857, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-12', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424} 2025-03-12 09:33:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20358424&page=1> {'review': 'Biryani was good, pepper mushroom was very very oily not even edible', 'review_id': 285248857, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-12', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424} 2025-03-12 09:33:35 [reviews] INFO: Scraped item: {'review': 'excellent ', 'review_id': 285156881, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424} 2025-03-12 09:33:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20358424&page=1> {'review': 'excellent ', 'review_id': 285156881, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424} 2025-03-12 09:33:35 [reviews] INFO: Scraped item: {'review': 'awesome ', 'review_id': 285156539, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424} 2025-03-12 09:33:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20358424&page=1> {'review': 'awesome ', 'review_id': 285156539, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424} 2025-03-12 09:33:35 [reviews] INFO: Scraped item: {'review': 'excellent ', 'review_id': 285155749, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424} 2025-03-12 09:33:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20358424&page=1> {'review': 'excellent ', 'review_id': 285155749, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424} 2025-03-12 09:33:35 [reviews] INFO: Scraped item: {'review': 'awesome ', 'review_id': 285152952, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424} 2025-03-12 09:33:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20358424&page=1> {'review': 'awesome ', 'review_id': 285152952, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424} 2025-03-12 09:33:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:33:39 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 74, 'brand_name': "Good Flippin' Burgers", 'city': 'Gurgaon', 'sub_zone': 'Udyog Vihar', 'platform': 'zomato', 'res_id': 20382650, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771965, 'download_latency': 0.7229757308959961, 'depth': 0} 2025-03-12 09:33:39 [reviews] INFO: Stopping for res_id: 20382650 as reviews are older than 7 days. 2025-03-12 09:33:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:33:43 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771968, 'download_latency': 0.6848931312561035, 'depth': 0} 2025-03-12 09:33:43 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284475345, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081} 2025-03-12 09:33:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20388081&page=1> {'review': '', 'review_id': 284475345, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081} 2025-03-12 09:33:43 [reviews] INFO: Scraped item: {'review': 'A lot of oil', 'review_id': 284018889, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081} 2025-03-12 09:33:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20388081&page=1> {'review': 'A lot of oil', 'review_id': 284018889, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081} 2025-03-12 09:33:43 [reviews] INFO: Scraped item: {'review': 'Anuj Chohan served well and kind enough to suggest dishes to try. Thank you', 'review_id': 283687153, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081} 2025-03-12 09:33:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20388081&page=1> {'review': 'Anuj Chohan served well and kind enough to suggest dishes to try. Thank you', 'review_id': 283687153, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081} 2025-03-12 09:33:43 [reviews] INFO: Stopping for res_id: 20388081 as reviews are older than 7 days. 2025-03-12 09:33:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:33:47 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 20420004, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771972, 'download_latency': 0.7321982383728027, 'depth': 0} 2025-03-12 09:33:47 [reviews] INFO: Scraped item: {'review': 'Too much salt in all biryani, cooked in a hurry. Some veggies were raw.', 'review_id': 285213060, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 20420004} 2025-03-12 09:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20420004&page=1> {'review': 'Too much salt in all biryani, cooked in a hurry. Some veggies were raw.', 'review_id': 285213060, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 20420004} 2025-03-12 09:33:47 [reviews] INFO: Scraped item: {'review': 'Wrong delivery I have order veg paneer Hyderabadi biryani you delivered egg biryani', 'review_id': 285199444, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 20420004} 2025-03-12 09:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20420004&page=1> {'review': 'Wrong delivery I have order veg paneer Hyderabadi biryani you delivered egg biryani', 'review_id': 285199444, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 20420004} 2025-03-12 09:33:47 [reviews] INFO: Scraped item: {'review': 'Food was very dry... ', 'review_id': 285142081, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 20420004} 2025-03-12 09:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20420004&page=1> {'review': 'Food was very dry... ', 'review_id': 285142081, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 20420004} 2025-03-12 09:33:47 [reviews] INFO: Scraped item: {'review': 'Very tasty', 'review_id': 285004041, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 20420004} 2025-03-12 09:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20420004&page=1> {'review': 'Very tasty', 'review_id': 285004041, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 20420004} 2025-03-12 09:33:47 [reviews] INFO: Scraped item: {'review': 'nice', 'review_id': 284868259, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 20420004} 2025-03-12 09:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20420004&page=1> {'review': 'nice', 'review_id': 284868259, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 20420004} 2025-03-12 09:33:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:33:51 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 31, 'brand_name': 'Twenty Seven Bake House', 'city': 'Mumbai', 'sub_zone': 'Mahalaxmi', 'platform': 'zomato', 'res_id': 20420093, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741771976, 'download_latency': 0.7411966323852539, 'depth': 0} 2025-03-12 09:33:51 [reviews] INFO: Stopping for res_id: 20420093 as reviews are older than 7 days. 2025-03-12 09:33:52 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:33:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-12 09:33:57 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-12 09:33:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:33:57 [scrapy.extensions.logstats] INFO: Crawled 158 pages (at 5 pages/min), scraped 502 items (at 13 items/min) 2025-03-12 09:33:59 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:34:03 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:34:05 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:34:08 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:34:13 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:34:14 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:34:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:34:20 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772005, 'download_latency': 1.6688566207885742, 'depth': 0} 2025-03-12 09:34:20 [reviews] INFO: Scraped item: {'review': 'Not worth money too less quantity', 'review_id': 284961704, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117} 2025-03-12 09:34:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20440117&page=1> {'review': 'Not worth money too less quantity', 'review_id': 284961704, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117} 2025-03-12 09:34:20 [reviews] INFO: Scraped item: {'review': 'Very late.... 30 minutes later than expected and hence food was cold', 'review_id': 284115991, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117} 2025-03-12 09:34:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20440117&page=1> {'review': 'Very late.... 30 minutes later than expected and hence food was cold', 'review_id': 284115991, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117} 2025-03-12 09:34:20 [reviews] INFO: Scraped item: {'review': 'not very great ', 'review_id': 284093773, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117} 2025-03-12 09:34:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20440117&page=1> {'review': 'not very great ', 'review_id': 284093773, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117} 2025-03-12 09:34:20 [reviews] INFO: Scraped item: {'review': 'Great', 'review_id': 283951029, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117} 2025-03-12 09:34:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20440117&page=1> {'review': 'Great', 'review_id': 283951029, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117} 2025-03-12 09:34:20 [reviews] INFO: Scraped item: {'review': 'Too much oil', 'review_id': 283910374, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117} 2025-03-12 09:34:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20440117&page=1> {'review': 'Too much oil', 'review_id': 283910374, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117} 2025-03-12 09:34:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:34:22 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20448735, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772009, 'download_latency': 0.7071175575256348, 'depth': 0} 2025-03-12 09:34:22 [reviews] INFO: Scraped item: {'review': 'the worst. no other words. vanilla cake slice ridiculous, buttercream was hard and sugary. banana pudding tasted like baby food.', 'review_id': 284966675, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20448735} 2025-03-12 09:34:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20448735&page=1> {'review': 'the worst. no other words. vanilla cake slice ridiculous, buttercream was hard and sugary. banana pudding tasted like baby food.', 'review_id': 284966675, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20448735} 2025-03-12 09:34:22 [reviews] INFO: Scraped item: {'review': 'The best in town', 'review_id': 284907035, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20448735} 2025-03-12 09:34:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20448735&page=1> {'review': 'The best in town', 'review_id': 284907035, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20448735} 2025-03-12 09:34:22 [reviews] INFO: Scraped item: {'review': 'Missing items ! No concerned person from either zomato or Magnolia', 'review_id': 284372793, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20448735} 2025-03-12 09:34:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20448735&page=1> {'review': 'Missing items ! No concerned person from either zomato or Magnolia', 'review_id': 284372793, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20448735} 2025-03-12 09:34:22 [reviews] INFO: Scraped item: {'review': 'Worst staff n manager ridiculous behaviour by them no respect to customer needs', 'review_id': 284303782, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20448735} 2025-03-12 09:34:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20448735&page=1> {'review': 'Worst staff n manager ridiculous behaviour by them no respect to customer needs', 'review_id': 284303782, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20448735} 2025-03-12 09:34:22 [reviews] INFO: Stopping for res_id: 20448735 as reviews are older than 7 days. 2025-03-12 09:34:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:34:26 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 32, 'brand_name': 'Third Wave Coffee', 'city': 'Mumbai', 'sub_zone': 'Colaba', 'platform': 'zomato', 'res_id': 20509246, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772011, 'download_latency': 0.7978601455688477, 'depth': 0} 2025-03-12 09:34:26 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284634968, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 32, 'brand_name': 'Third Wave Coffee', 'city': 'Mumbai', 'sub_zone': 'Colaba', 'platform': 'zomato', 'res_id': 20509246} 2025-03-12 09:34:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20509246&page=1> {'review': '', 'review_id': 284634968, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 32, 'brand_name': 'Third Wave Coffee', 'city': 'Mumbai', 'sub_zone': 'Colaba', 'platform': 'zomato', 'res_id': 20509246} 2025-03-12 09:34:26 [reviews] INFO: Scraped item: {'review': '👍🏻', 'review_id': 283482029, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 32, 'brand_name': 'Third Wave Coffee', 'city': 'Mumbai', 'sub_zone': 'Colaba', 'platform': 'zomato', 'res_id': 20509246} 2025-03-12 09:34:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20509246&page=1> {'review': '👍🏻', 'review_id': 283482029, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 32, 'brand_name': 'Third Wave Coffee', 'city': 'Mumbai', 'sub_zone': 'Colaba', 'platform': 'zomato', 'res_id': 20509246} 2025-03-12 09:34:26 [reviews] INFO: Stopping for res_id: 20509246 as reviews are older than 7 days. 2025-03-12 09:34:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:34:29 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772016, 'download_latency': 0.7037708759307861, 'depth': 0} 2025-03-12 09:34:29 [reviews] INFO: Scraped item: {'review': 'The taste was good but the gravy was too oily. Not sure but I think dine-in is much better and even the quantity provided is more as compared to the delivery portion.', 'review_id': 285272099, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-12', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112} 2025-03-12 09:34:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20516112&page=1> {'review': 'The taste was good but the gravy was too oily. Not sure but I think dine-in is much better and even the quantity provided is more as compared to the delivery portion.', 'review_id': 285272099, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-12', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112} 2025-03-12 09:34:29 [reviews] INFO: Scraped item: {'review': 'worst taste', 'review_id': 285155479, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112} 2025-03-12 09:34:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20516112&page=1> {'review': 'worst taste', 'review_id': 285155479, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112} 2025-03-12 09:34:29 [reviews] INFO: Scraped item: {'review': 'tandoori chicken was good but the other chicken was not tender ( white tangdi tandoori chicken) ', 'review_id': 285003626, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112} 2025-03-12 09:34:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20516112&page=1> {'review': 'tandoori chicken was good but the other chicken was not tender ( white tangdi tandoori chicken) ', 'review_id': 285003626, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112} 2025-03-12 09:34:29 [reviews] INFO: Scraped item: {'review': 'all food was too oily!', 'review_id': 284953312, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112} 2025-03-12 09:34:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20516112&page=1> {'review': 'all food was too oily!', 'review_id': 284953312, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112} 2025-03-12 09:34:29 [reviews] INFO: Scraped item: {'review': 'The restaurant delay the service for 1 hour', 'review_id': 284518481, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112} 2025-03-12 09:34:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20516112&page=1> {'review': 'The restaurant delay the service for 1 hour', 'review_id': 284518481, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112} 2025-03-12 09:34:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:34:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:34:36 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 35, 'brand_name': 'True Black Specialty Coffee', 'city': 'Hyderabad ', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20517056, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772023, 'download_latency': 0.693875789642334, 'depth': 0} 2025-03-12 09:34:36 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284744400, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 35, 'brand_name': 'True Black Specialty Coffee', 'city': 'Hyderabad ', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20517056} 2025-03-12 09:34:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517056&page=1> {'review': '', 'review_id': 284744400, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 35, 'brand_name': 'True Black Specialty Coffee', 'city': 'Hyderabad ', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20517056} 2025-03-12 09:34:36 [reviews] INFO: Stopping for res_id: 20517056 as reviews are older than 7 days. 2025-03-12 09:34:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:34:40 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772027, 'download_latency': 0.7065222263336182, 'depth': 0} 2025-03-12 09:34:40 [reviews] INFO: Scraped item: {'review': 'So sad it was very bad so much oil i ordered crispy hunan chicken and dont knw what has been sent so bad not eatable i hve visted ur restaurant and have eaten this before but this is not the same thing plzzz guys we pay so much including taxes', 'review_id': 284531524, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146} 2025-03-12 09:34:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517146&page=1> {'review': 'So sad it was very bad so much oil i ordered crispy hunan chicken and dont knw what has been sent so bad not eatable i hve visted ur restaurant and have eaten this before but this is not the same thing plzzz guys we pay so much including taxes', 'review_id': 284531524, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146} 2025-03-12 09:34:40 [reviews] INFO: Scraped item: {'review': 'Fried rice is too dry', 'review_id': 284495077, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146} 2025-03-12 09:34:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517146&page=1> {'review': 'Fried rice is too dry', 'review_id': 284495077, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146} 2025-03-12 09:34:40 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284046171, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146} 2025-03-12 09:34:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517146&page=1> {'review': '', 'review_id': 284046171, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146} 2025-03-12 09:34:40 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283370295, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146} 2025-03-12 09:34:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517146&page=1> {'review': '', 'review_id': 283370295, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146} 2025-03-12 09:34:40 [reviews] INFO: Stopping for res_id: 20517146 as reviews are older than 7 days. 2025-03-12 09:34:43 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:34:47 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:34:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:34:55 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:34:56 [scrapy.extensions.logstats] INFO: Crawled 164 pages (at 6 pages/min), scraped 523 items (at 21 items/min) 2025-03-12 09:34:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:35:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:35:05 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:35:10 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:35:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:35:14 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 51, 'brand_name': 'Soba Sassy', 'city': 'Kolkata', 'sub_zone': 'Camac Street Area', 'platform': 'zomato', 'res_id': 20528405, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772055, 'download_latency': 0.7278323173522949, 'depth': 0} 2025-03-12 09:35:14 [reviews] INFO: Scraped item: {'review': 'fantastic interiors! excellent staff! ', 'review_id': 284924332, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 51, 'brand_name': 'Soba Sassy', 'city': 'Kolkata', 'sub_zone': 'Camac Street Area', 'platform': 'zomato', 'res_id': 20528405} 2025-03-12 09:35:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20528405&page=1> {'review': 'fantastic interiors! excellent staff! ', 'review_id': 284924332, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 51, 'brand_name': 'Soba Sassy', 'city': 'Kolkata', 'sub_zone': 'Camac Street Area', 'platform': 'zomato', 'res_id': 20528405} 2025-03-12 09:35:14 [reviews] INFO: Stopping for res_id: 20528405 as reviews are older than 7 days. 2025-03-12 09:35:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:35:19 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Veera Desai Area', 'platform': 'zomato', 'res_id': 20541482, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772060, 'download_latency': 0.7052710056304932, 'depth': 0} 2025-03-12 09:35:19 [reviews] INFO: Scraped item: {'review': 'too dry poor quality biryani no taste at all.
quality has degraded a lot', 'review_id': 284967609, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Veera Desai Area', 'platform': 'zomato', 'res_id': 20541482} 2025-03-12 09:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20541482&page=1> {'review': 'too dry poor quality biryani no taste at all.
quality has degraded a lot', 'review_id': 284967609, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Veera Desai Area', 'platform': 'zomato', 'res_id': 20541482} 2025-03-12 09:35:19 [reviews] INFO: Scraped item: {'review': 'Ordered Veg Hyderabadi Dum Biryani and it surpassed my expectations. It was too good and served hot. ', 'review_id': 284540838, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Veera Desai Area', 'platform': 'zomato', 'res_id': 20541482} 2025-03-12 09:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20541482&page=1> {'review': 'Ordered Veg Hyderabadi Dum Biryani and it surpassed my expectations. It was too good and served hot. ', 'review_id': 284540838, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Veera Desai Area', 'platform': 'zomato', 'res_id': 20541482} 2025-03-12 09:35:19 [reviews] INFO: Scraped item: {'review': 'very good 👍 ', 'review_id': 284445862, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Veera Desai Area', 'platform': 'zomato', 'res_id': 20541482} 2025-03-12 09:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20541482&page=1> {'review': 'very good 👍 ', 'review_id': 284445862, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Veera Desai Area', 'platform': 'zomato', 'res_id': 20541482} 2025-03-12 09:35:19 [reviews] INFO: Scraped item: {'review': 'baf ', 'review_id': 284353238, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Veera Desai Area', 'platform': 'zomato', 'res_id': 20541482} 2025-03-12 09:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20541482&page=1> {'review': 'baf ', 'review_id': 284353238, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Veera Desai Area', 'platform': 'zomato', 'res_id': 20541482} 2025-03-12 09:35:19 [reviews] INFO: Scraped item: {'review': 'lot of salt ', 'review_id': 284221017, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Veera Desai Area', 'platform': 'zomato', 'res_id': 20541482} 2025-03-12 09:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20541482&page=1> {'review': 'lot of salt ', 'review_id': 284221017, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Veera Desai Area', 'platform': 'zomato', 'res_id': 20541482} 2025-03-12 09:35:21 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:35:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:35:26 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Inorbit Mall', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20587336, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772066, 'download_latency': 0.7223267555236816, 'depth': 0} 2025-03-12 09:35:26 [reviews] INFO: Scraped item: {'review': 'tasty food making Brison chife ', 'review_id': 285184974, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Inorbit Mall', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20587336} 2025-03-12 09:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20587336&page=1> {'review': 'tasty food making Brison chife ', 'review_id': 285184974, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Inorbit Mall', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20587336} 2025-03-12 09:35:26 [reviews] INFO: Scraped item: {'review': 'good tast', 'review_id': 285181499, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Inorbit Mall', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20587336} 2025-03-12 09:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20587336&page=1> {'review': 'good tast', 'review_id': 285181499, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Inorbit Mall', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20587336} 2025-03-12 09:35:26 [reviews] INFO: Scraped item: {'review': 'good food ', 'review_id': 284738796, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Inorbit Mall', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20587336} 2025-03-12 09:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20587336&page=1> {'review': 'good food ', 'review_id': 284738796, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Inorbit Mall', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20587336} 2025-03-12 09:35:26 [reviews] INFO: Scraped item: {'review': 'momo is so yammy ', 'review_id': 284736139, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Inorbit Mall', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20587336} 2025-03-12 09:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20587336&page=1> {'review': 'momo is so yammy ', 'review_id': 284736139, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Inorbit Mall', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20587336} 2025-03-12 09:35:26 [reviews] INFO: Scraped item: {'review': 'nice momo', 'review_id': 284733892, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Inorbit Mall', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20587336} 2025-03-12 09:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20587336&page=1> {'review': 'nice momo', 'review_id': 284733892, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Inorbit Mall', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20587336} 2025-03-12 09:35:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:35:29 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 20646811, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772069, 'download_latency': 0.7051453590393066, 'depth': 0} 2025-03-12 09:35:29 [reviews] INFO: Scraped item: {'review': 'Disgusting is this the way you treat your elite clients by sending them stale food pathetic service', 'review_id': 285202490, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 20646811} 2025-03-12 09:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20646811&page=1> {'review': 'Disgusting is this the way you treat your elite clients by sending them stale food pathetic service', 'review_id': 285202490, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 20646811} 2025-03-12 09:35:29 [reviews] INFO: Scraped item: {'review': 'Look how the pasta looks, no toppings, no oregano nothing', 'review_id': 283761811, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 20646811} 2025-03-12 09:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20646811&page=1> {'review': 'Look how the pasta looks, no toppings, no oregano nothing', 'review_id': 283761811, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 20646811} 2025-03-12 09:35:29 [reviews] INFO: Scraped item: {'review': 'Garlic bread had no butter', 'review_id': 283730585, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 20646811} 2025-03-12 09:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20646811&page=1> {'review': 'Garlic bread had no butter', 'review_id': 283730585, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 20646811} 2025-03-12 09:35:29 [reviews] INFO: Stopping for res_id: 20646811 as reviews are older than 7 days. 2025-03-12 09:35:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:35:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:35:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:35:41 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772081, 'download_latency': 0.7917346954345703, 'depth': 0} 2025-03-12 09:35:41 [reviews] INFO: Scraped item: {'review': "didn't like the taste", 'review_id': 285152552, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045} 2025-03-12 09:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20660045&page=1> {'review': "didn't like the taste", 'review_id': 285152552, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045} 2025-03-12 09:35:41 [reviews] INFO: Scraped item: {'review': 'I found pieces of non veg in their paneer biryani', 'review_id': 284613436, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045} 2025-03-12 09:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20660045&page=1> {'review': 'I found pieces of non veg in their paneer biryani', 'review_id': 284613436, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045} 2025-03-12 09:35:41 [reviews] INFO: Scraped item: {'review': "the images shown on app are totally at variance with what they deliver and I don't know how zomato rates the restaurant has 4 and above", 'review_id': 284541323, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045} 2025-03-12 09:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20660045&page=1> {'review': "the images shown on app are totally at variance with what they deliver and I don't know how zomato rates the restaurant has 4 and above", 'review_id': 284541323, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045} 2025-03-12 09:35:41 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284529015, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045} 2025-03-12 09:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20660045&page=1> {'review': '', 'review_id': 284529015, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045} 2025-03-12 09:35:41 [reviews] INFO: Scraped item: {'review': 'i order most of time from them only. but today it want worth. seem like stalled. Paneers were smelly. ', 'review_id': 284335615, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045} 2025-03-12 09:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20660045&page=1> {'review': 'i order most of time from them only. but today it want worth. seem like stalled. Paneers were smelly. ', 'review_id': 284335615, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045} 2025-03-12 09:35:43 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:35:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:35:51 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:35:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:35:56 [scrapy.extensions.logstats] INFO: Crawled 169 pages (at 5 pages/min), scraped 542 items (at 19 items/min) 2025-03-12 09:35:56 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:36:00 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:36:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:36:05 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 37, 'brand_name': 'Blue Tokai Coffee Roasters', 'city': 'Bangalore', 'sub_zone': 'Domlur', 'platform': 'zomato', 'res_id': 20661130, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772106, 'download_latency': 0.7332019805908203, 'depth': 0} 2025-03-12 09:36:05 [reviews] INFO: Stopping for res_id: 20661130 as reviews are older than 7 days. 2025-03-12 09:36:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:36:09 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772110, 'download_latency': 0.701789379119873, 'depth': 0} 2025-03-12 09:36:09 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283673186, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565} 2025-03-12 09:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20667565&page=1> {'review': '', 'review_id': 283673186, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565} 2025-03-12 09:36:09 [reviews] INFO: Scraped item: {'review': 'It was a very smooth experience. The valet parking at Yazu is a lifesaver in busy Lower Parel. The food and drinks were as excellent as the service. Loved the ambiance and prompt attention from the staff.', 'review_id': 283672589, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565} 2025-03-12 09:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20667565&page=1> {'review': 'It was a very smooth experience. The valet parking at Yazu is a lifesaver in busy Lower Parel. The food and drinks were as excellent as the service. Loved the ambiance and prompt attention from the staff.', 'review_id': 283672589, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565} 2025-03-12 09:36:09 [reviews] INFO: Scraped item: {'review': "I must say Yazu is an ideal date night spot in Andheri. Also, it's an gastronomic delight for Asian food lovers. Me and my girlfriend loved the dimsum and Baos. Also, the drinks are well made.", 'review_id': 283659519, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565} 2025-03-12 09:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20667565&page=1> {'review': "I must say Yazu is an ideal date night spot in Andheri. Also, it's an gastronomic delight for Asian food lovers. Me and my girlfriend loved the dimsum and Baos. Also, the drinks are well made.", 'review_id': 283659519, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565} 2025-03-12 09:36:09 [reviews] INFO: Scraped item: {'review': 'Yazu is a paradise for Asian cuisine enthusiasts. The Prawn Xo Dumplings and Lamb in Black Pepper Sauce were bursting with flavors. The cocktails and music enhanced the overall experience.', 'review_id': 283649628, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565} 2025-03-12 09:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20667565&page=1> {'review': 'Yazu is a paradise for Asian cuisine enthusiasts. The Prawn Xo Dumplings and Lamb in Black Pepper Sauce were bursting with flavors. The cocktails and music enhanced the overall experience.', 'review_id': 283649628, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565} 2025-03-12 09:36:09 [reviews] INFO: Stopping for res_id: 20667565 as reviews are older than 7 days. 2025-03-12 09:36:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:36:12 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 47, 'brand_name': 'ASIE', 'city': 'Hyderabad', 'sub_zone': 'Gachibowli', 'platform': 'zomato', 'res_id': 20682991, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772115, 'download_latency': 0.7134871482849121, 'depth': 0} 2025-03-12 09:36:12 [reviews] ERROR: Error parsing date: an hour ago, error: unsupported type for timedelta hours component: NoneType 2025-03-12 09:36:12 [reviews] INFO: Stopping for res_id: 20682991 due to unrecognized date format: an hour ago. 2025-03-12 09:36:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:36:15 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 3, 'brand_name': 'JuCo Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 20789516, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772119, 'download_latency': 0.6951344013214111, 'depth': 0} 2025-03-12 09:36:15 [reviews] INFO: Scraped item: {'review': '', 'review_id': 285198401, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 3, 'brand_name': 'JuCo Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 20789516} 2025-03-12 09:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20789516&page=1> {'review': '', 'review_id': 285198401, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 3, 'brand_name': 'JuCo Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 20789516} 2025-03-12 09:36:15 [reviews] INFO: Scraped item: {'review': 'Food was very good .', 'review_id': 284856095, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 3, 'brand_name': 'JuCo Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 20789516} 2025-03-12 09:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20789516&page=1> {'review': 'Food was very good .', 'review_id': 284856095, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 3, 'brand_name': 'JuCo Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 20789516} 2025-03-12 09:36:15 [reviews] INFO: Scraped item: {'review': 'it was so dry and no where close to falafel. the wrap had cucumber and hardly any pieces of falafel. it was so brittle ', 'review_id': 284290707, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 3, 'brand_name': 'JuCo Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 20789516} 2025-03-12 09:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20789516&page=1> {'review': 'it was so dry and no where close to falafel. the wrap had cucumber and hardly any pieces of falafel. it was so brittle ', 'review_id': 284290707, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 3, 'brand_name': 'JuCo Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 20789516} 2025-03-12 09:36:15 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283664021, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 3, 'brand_name': 'JuCo Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 20789516} 2025-03-12 09:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20789516&page=1> {'review': '', 'review_id': 283664021, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 3, 'brand_name': 'JuCo Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 20789516} 2025-03-12 09:36:15 [reviews] INFO: Stopping for res_id: 20789516 as reviews are older than 7 days. 2025-03-12 09:36:19 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:36:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:36:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:36:30 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:36:34 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:36:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:36:40 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 75, 'brand_name': 'Louis Burger', 'city': 'Gurgaon', 'sub_zone': 'Udyog Vihar', 'platform': 'zomato', 'res_id': 20801316, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772141, 'download_latency': 2.584439754486084, 'depth': 0} 2025-03-12 09:36:40 [reviews] INFO: Scraped item: {'review': 'the popcorns could be softer. They were a bit chewy in between bites. Apart from that tasted good', 'review_id': 284972100, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 75, 'brand_name': 'Louis Burger', 'city': 'Gurgaon', 'sub_zone': 'Udyog Vihar', 'platform': 'zomato', 'res_id': 20801316} 2025-03-12 09:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20801316&page=1> {'review': 'the popcorns could be softer. They were a bit chewy in between bites. Apart from that tasted good', 'review_id': 284972100, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 75, 'brand_name': 'Louis Burger', 'city': 'Gurgaon', 'sub_zone': 'Udyog Vihar', 'platform': 'zomato', 'res_id': 20801316} 2025-03-12 09:36:40 [reviews] INFO: Scraped item: {'review': 'The amazing burger I have ever had. My only fav chicken burger so far. And the taste gets more enhance with the dips they are giving along.', 'review_id': 284869126, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 75, 'brand_name': 'Louis Burger', 'city': 'Gurgaon', 'sub_zone': 'Udyog Vihar', 'platform': 'zomato', 'res_id': 20801316} 2025-03-12 09:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20801316&page=1> {'review': 'The amazing burger I have ever had. My only fav chicken burger so far. And the taste gets more enhance with the dips they are giving along.', 'review_id': 284869126, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 75, 'brand_name': 'Louis Burger', 'city': 'Gurgaon', 'sub_zone': 'Udyog Vihar', 'platform': 'zomato', 'res_id': 20801316} 2025-03-12 09:36:40 [reviews] INFO: Scraped item: {'review': 'food clod and chicken was like rubber ', 'review_id': 284501918, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 75, 'brand_name': 'Louis Burger', 'city': 'Gurgaon', 'sub_zone': 'Udyog Vihar', 'platform': 'zomato', 'res_id': 20801316} 2025-03-12 09:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20801316&page=1> {'review': 'food clod and chicken was like rubber ', 'review_id': 284501918, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 75, 'brand_name': 'Louis Burger', 'city': 'Gurgaon', 'sub_zone': 'Udyog Vihar', 'platform': 'zomato', 'res_id': 20801316} 2025-03-12 09:36:40 [reviews] INFO: Scraped item: {'review': 'Stinking burger, seems undercooked or poor quality oil/sauce used. Not edible.', 'review_id': 283651592, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 75, 'brand_name': 'Louis Burger', 'city': 'Gurgaon', 'sub_zone': 'Udyog Vihar', 'platform': 'zomato', 'res_id': 20801316} 2025-03-12 09:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20801316&page=1> {'review': 'Stinking burger, seems undercooked or poor quality oil/sauce used. Not edible.', 'review_id': 283651592, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 75, 'brand_name': 'Louis Burger', 'city': 'Gurgaon', 'sub_zone': 'Udyog Vihar', 'platform': 'zomato', 'res_id': 20801316} 2025-03-12 09:36:40 [reviews] INFO: Stopping for res_id: 20801316 as reviews are older than 7 days. 2025-03-12 09:36:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:36:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:36:48 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:36:52 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:36:56 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:36:56 [scrapy.extensions.logstats] INFO: Crawled 174 pages (at 5 pages/min), scraped 554 items (at 12 items/min) 2025-03-12 09:37:00 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:37:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:37:04 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Ahmedabad ', 'sub_zone': 'Palladium Mall', 'platform': 'zomato', 'res_id': 20816697, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772165, 'download_latency': 0.9790441989898682, 'depth': 0} 2025-03-12 09:37:04 [reviews] INFO: Scraped item: {'review': 'good food.', 'review_id': 284526997, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Ahmedabad ', 'sub_zone': 'Palladium Mall', 'platform': 'zomato', 'res_id': 20816697} 2025-03-12 09:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20816697&page=1> {'review': 'good food.', 'review_id': 284526997, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Ahmedabad ', 'sub_zone': 'Palladium Mall', 'platform': 'zomato', 'res_id': 20816697} 2025-03-12 09:37:04 [reviews] INFO: Scraped item: {'review': 'every dish smelled like fish', 'review_id': 283627400, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Ahmedabad ', 'sub_zone': 'Palladium Mall', 'platform': 'zomato', 'res_id': 20816697} 2025-03-12 09:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20816697&page=1> {'review': 'every dish smelled like fish', 'review_id': 283627400, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Ahmedabad ', 'sub_zone': 'Palladium Mall', 'platform': 'zomato', 'res_id': 20816697} 2025-03-12 09:37:04 [reviews] INFO: Stopping for res_id: 20816697 as reviews are older than 7 days. 2025-03-12 09:37:08 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:37:08 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20828825, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772170, 'download_latency': 0.9236698150634766, 'depth': 0} 2025-03-12 09:37:08 [reviews] INFO: Scraped item: {'review': 'The pasta was good, a bit spicy. What disappointed was there was no cutlery sent even after a specific request. Please send it when requested, as we dont carry it with us always..
', 'review_id': 284131550, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20828825} 2025-03-12 09:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20828825&page=1> {'review': 'The pasta was good, a bit spicy. What disappointed was there was no cutlery sent even after a specific request. Please send it when requested, as we dont carry it with us always..
', 'review_id': 284131550, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20828825} 2025-03-12 09:37:08 [reviews] INFO: Stopping for res_id: 20828825 as reviews are older than 7 days. 2025-03-12 09:37:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:37:17 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772176, 'download_latency': 1.8013849258422852, 'depth': 0} 2025-03-12 09:37:17 [reviews] INFO: Scraped item: {'review': 'should have given salan as well, also the quantity could have been a bit more for one. ', 'review_id': 285181571, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681} 2025-03-12 09:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20880681&page=1> {'review': 'should have given salan as well, also the quantity could have been a bit more for one. ', 'review_id': 285181571, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681} 2025-03-12 09:37:17 [reviews] INFO: Scraped item: {'review': 'raita was not present.', 'review_id': 284982382, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681} 2025-03-12 09:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20880681&page=1> {'review': 'raita was not present.', 'review_id': 284982382, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681} 2025-03-12 09:37:17 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284913920, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681} 2025-03-12 09:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20880681&page=1> {'review': '', 'review_id': 284913920, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681} 2025-03-12 09:37:17 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284855994, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681} 2025-03-12 09:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20880681&page=1> {'review': '', 'review_id': 284855994, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681} 2025-03-12 09:37:17 [reviews] INFO: Scraped item: {'review': 'Extra chilli added for no tatse', 'review_id': 284182800, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681} 2025-03-12 09:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20880681&page=1> {'review': 'Extra chilli added for no tatse', 'review_id': 284182800, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681} 2025-03-12 09:37:19 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:37:23 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:37:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:37:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:37:35 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:37:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:37:39 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 3, 'brand_name': 'Achija', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 20895131, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772201, 'download_latency': 0.7714056968688965, 'depth': 0} 2025-03-12 09:37:39 [reviews] ERROR: Unrecognized relative_date format: 45 minutes ago 2025-03-12 09:37:39 [reviews] INFO: Stopping for res_id: 20895131 due to unrecognized date format: 45 minutes ago. 2025-03-12 09:37:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): User timeout caused connection failure: Getting https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20844186&page=1 took longer than 30.0 seconds.. 2025-03-12 09:37:43 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:37:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:37:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:37:51 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772209, 'download_latency': 0.785775899887085, 'depth': 0} 2025-03-12 09:37:51 [reviews] INFO: Scraped item: {'review': 'all was nice only strong Kevada essence for biryani was a bit more', 'review_id': 285194932, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097} 2025-03-12 09:37:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20896097&page=1> {'review': 'all was nice only strong Kevada essence for biryani was a bit more', 'review_id': 285194932, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097} 2025-03-12 09:37:51 [reviews] INFO: Scraped item: {'review': 'excellent food with quite amazing staff and ambience also sugestions from Satyanand were amazing', 'review_id': 283425583, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-06', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097} 2025-03-12 09:37:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20896097&page=1> {'review': 'excellent food with quite amazing staff and ambience also sugestions from Satyanand were amazing', 'review_id': 283425583, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-06', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097} 2025-03-12 09:37:51 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283189819, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097} 2025-03-12 09:37:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20896097&page=1> {'review': '', 'review_id': 283189819, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097} 2025-03-12 09:37:51 [reviews] INFO: Stopping for res_id: 20896097 as reviews are older than 7 days. 2025-03-12 09:37:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:37:55 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772213, 'download_latency': 0.7777559757232666, 'depth': 0} 2025-03-12 09:37:55 [reviews] INFO: Scraped item: {'review': 'Taste good but turmeric was too much in filing
', 'review_id': 283929131, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523} 2025-03-12 09:37:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20907523&page=1> {'review': 'Taste good but turmeric was too much in filing
', 'review_id': 283929131, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523} 2025-03-12 09:37:55 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283549454, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523} 2025-03-12 09:37:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20907523&page=1> {'review': '', 'review_id': 283549454, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523} 2025-03-12 09:37:55 [reviews] INFO: Scraped item: {'review': 'excessively oily food, tasteless, the khichdi hardly had any rice in it', 'review_id': 283241946, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523} 2025-03-12 09:37:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20907523&page=1> {'review': 'excessively oily food, tasteless, the khichdi hardly had any rice in it', 'review_id': 283241946, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523} 2025-03-12 09:37:55 [reviews] INFO: Scraped item: {'review': 'little late ', 'review_id': 283240022, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523} 2025-03-12 09:37:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20907523&page=1> {'review': 'little late ', 'review_id': 283240022, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523} 2025-03-12 09:37:55 [reviews] INFO: Stopping for res_id: 20907523 as reviews are older than 7 days. 2025-03-12 09:37:56 [scrapy.extensions.logstats] INFO: Crawled 180 pages (at 6 pages/min), scraped 569 items (at 15 items/min) 2025-03-12 09:37:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:37:58 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772216, 'download_latency': 0.7755279541015625, 'depth': 0} 2025-03-12 09:37:58 [reviews] INFO: Scraped item: {'review': 'amazing food ', 'review_id': 285146313, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125} 2025-03-12 09:37:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20998125&page=1> {'review': 'amazing food ', 'review_id': 285146313, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125} 2025-03-12 09:37:58 [reviews] INFO: Scraped item: {'review': 'there is a slight change in mapo tofu I had last time but it was good ', 'review_id': 284345749, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125} 2025-03-12 09:37:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20998125&page=1> {'review': 'there is a slight change in mapo tofu I had last time but it was good ', 'review_id': 284345749, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125} 2025-03-12 09:37:58 [reviews] INFO: Scraped item: {'review': 'Mr. Anil was really helpful and kind. Wonderful service.', 'review_id': 284095392, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125} 2025-03-12 09:37:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20998125&page=1> {'review': 'Mr. Anil was really helpful and kind. Wonderful service.', 'review_id': 284095392, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125} 2025-03-12 09:37:58 [reviews] INFO: Scraped item: {'review': 'Amazing staff, Anil Vishwakarma gave an good experience and amazing food', 'review_id': 284078549, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125} 2025-03-12 09:37:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20998125&page=1> {'review': 'Amazing staff, Anil Vishwakarma gave an good experience and amazing food', 'review_id': 284078549, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125} 2025-03-12 09:37:58 [reviews] INFO: Stopping for res_id: 20998125 as reviews are older than 7 days. 2025-03-12 09:38:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:38:02 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 48, 'brand_name': 'Sakura - A Far Eastern Kitchen', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 21012857, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772220, 'download_latency': 0.8259196281433105, 'depth': 0} 2025-03-12 09:38:02 [reviews] INFO: Scraped item: {'review': 'Overpriced food with zero ambience and unfriendly staff.', 'review_id': 284814692, 'rating': '2', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 48, 'brand_name': 'Sakura - A Far Eastern Kitchen', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 21012857} 2025-03-12 09:38:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21012857&page=1> {'review': 'Overpriced food with zero ambience and unfriendly staff.', 'review_id': 284814692, 'rating': '2', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 48, 'brand_name': 'Sakura - A Far Eastern Kitchen', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 21012857} 2025-03-12 09:38:02 [reviews] INFO: Scraped item: {'review': 'Sumptuous food and fast service', 'review_id': 284069857, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 48, 'brand_name': 'Sakura - A Far Eastern Kitchen', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 21012857} 2025-03-12 09:38:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21012857&page=1> {'review': 'Sumptuous food and fast service', 'review_id': 284069857, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 48, 'brand_name': 'Sakura - A Far Eastern Kitchen', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 21012857} 2025-03-12 09:38:02 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283759785, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 48, 'brand_name': 'Sakura - A Far Eastern Kitchen', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 21012857} 2025-03-12 09:38:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21012857&page=1> {'review': '', 'review_id': 283759785, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 48, 'brand_name': 'Sakura - A Far Eastern Kitchen', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 21012857} 2025-03-12 09:38:02 [reviews] INFO: Scraped item: {'review': 'The ambience was very Unique. The food was served hot and tasted very good. The hot stone noodles, Miso chicken ramen, chicken karage, Golden fried prawns were our favourites. The server Mr Srikanth was excellent. He was very prompt in his service and made sure to check on us if we needed anything. ', 'review_id': 283324576, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-06', 'competitor_id': 48, 'brand_name': 'Sakura - A Far Eastern Kitchen', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 21012857} 2025-03-12 09:38:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21012857&page=1> {'review': 'The ambience was very Unique. The food was served hot and tasted very good. The hot stone noodles, Miso chicken ramen, chicken karage, Golden fried prawns were our favourites. The server Mr Srikanth was excellent. He was very prompt in his service and made sure to check on us if we needed anything. ', 'review_id': 283324576, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-06', 'competitor_id': 48, 'brand_name': 'Sakura - A Far Eastern Kitchen', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 21012857} 2025-03-12 09:38:02 [reviews] INFO: Stopping for res_id: 21012857 as reviews are older than 7 days. 2025-03-12 09:38:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:38:06 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 29, 'brand_name': 'abCoffee', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21031542, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772225, 'download_latency': 0.8621461391448975, 'depth': 0} 2025-03-12 09:38:06 [reviews] INFO: Stopping for res_id: 21031542 as reviews are older than 7 days. 2025-03-12 09:38:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:38:09 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 3', 'platform': 'zomato', 'res_id': 21061214, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772228, 'download_latency': 0.892662763595581, 'depth': 0} 2025-03-12 09:38:09 [reviews] INFO: Scraped item: {'review': 'biryani rice was quite hard ', 'review_id': 283869251, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 3', 'platform': 'zomato', 'res_id': 21061214} 2025-03-12 09:38:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21061214&page=1> {'review': 'biryani rice was quite hard ', 'review_id': 283869251, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 3', 'platform': 'zomato', 'res_id': 21061214} 2025-03-12 09:38:09 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283705634, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 3', 'platform': 'zomato', 'res_id': 21061214} 2025-03-12 09:38:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21061214&page=1> {'review': '', 'review_id': 283705634, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 3', 'platform': 'zomato', 'res_id': 21061214} 2025-03-12 09:38:09 [reviews] INFO: Scraped item: {'review': 'No cutlery send and only one mutton small pic so badly experience', 'review_id': 283396547, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 3', 'platform': 'zomato', 'res_id': 21061214} 2025-03-12 09:38:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21061214&page=1> {'review': 'No cutlery send and only one mutton small pic so badly experience', 'review_id': 283396547, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 3', 'platform': 'zomato', 'res_id': 21061214} 2025-03-12 09:38:09 [reviews] INFO: Stopping for res_id: 21061214 as reviews are older than 7 days. 2025-03-12 09:38:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:38:12 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 29, 'brand_name': 'abCoffee', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 21091083, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772237, 'download_latency': 0.8395283222198486, 'depth': 0} 2025-03-12 09:38:12 [reviews] INFO: Scraped item: {'review': 'Espresso not packed well..it has burst from the bottom ', 'review_id': 283833480, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 29, 'brand_name': 'abCoffee', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 21091083} 2025-03-12 09:38:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21091083&page=1> {'review': 'Espresso not packed well..it has burst from the bottom ', 'review_id': 283833480, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 29, 'brand_name': 'abCoffee', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 21091083} 2025-03-12 09:38:12 [reviews] INFO: Stopping for res_id: 21091083 as reviews are older than 7 days. 2025-03-12 09:38:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:38:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:38:23 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:38:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:38:31 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:38:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:38:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:38:41 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772262, 'retry_times': 1, 'download_latency': 0.8172640800476074, 'depth': 0} 2025-03-12 09:38:41 [reviews] INFO: Scraped item: {'review': 'by mistake order curry only I want biryani the name is confusing ', 'review_id': 285278537, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-12', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186} 2025-03-12 09:38:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20844186&page=1> {'review': 'by mistake order curry only I want biryani the name is confusing ', 'review_id': 285278537, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-12', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186} 2025-03-12 09:38:41 [reviews] INFO: Scraped item: {'review': 'Great service by Balram.
He makes it worth visits thalairaj biryani once atleast in life.
Totally mesmerised with him.
Such a cute guy he is. 👌🏻', 'review_id': 285163896, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186} 2025-03-12 09:38:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20844186&page=1> {'review': 'Great service by Balram.
He makes it worth visits thalairaj biryani once atleast in life.
Totally mesmerised with him.
Such a cute guy he is. 👌🏻', 'review_id': 285163896, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186} 2025-03-12 09:38:41 [reviews] INFO: Scraped item: {'review': 'Balram was a great host', 'review_id': 285075430, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186} 2025-03-12 09:38:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20844186&page=1> {'review': 'Balram was a great host', 'review_id': 285075430, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186} 2025-03-12 09:38:41 [reviews] INFO: Scraped item: {'review': 'not exactly pepper paneer ', 'review_id': 285061305, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186} 2025-03-12 09:38:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20844186&page=1> {'review': 'not exactly pepper paneer ', 'review_id': 285061305, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186} 2025-03-12 09:38:41 [reviews] INFO: Scraped item: {'review': 'great taste and good quantity', 'review_id': 284511334, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186} 2025-03-12 09:38:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20844186&page=1> {'review': 'great taste and good quantity', 'review_id': 284511334, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186} 2025-03-12 09:38:44 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:38:48 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:38:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:38:51 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772271, 'download_latency': 0.9551310539245605, 'depth': 0} 2025-03-12 09:38:51 [reviews] INFO: Scraped item: {'review': 'absolutely very low quantity for the price ', 'review_id': 285001650, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421} 2025-03-12 09:38:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21131421&page=1> {'review': 'absolutely very low quantity for the price ', 'review_id': 285001650, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421} 2025-03-12 09:38:51 [reviews] INFO: Scraped item: {'review': 'mutton seekh is stale it tasted like mutton is 4 5 days old and it is smelly biryani chicken is also not good at all again it is smelly.', 'review_id': 284909884, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421} 2025-03-12 09:38:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21131421&page=1> {'review': 'mutton seekh is stale it tasted like mutton is 4 5 days old and it is smelly biryani chicken is also not good at all again it is smelly.', 'review_id': 284909884, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421} 2025-03-12 09:38:51 [reviews] INFO: Scraped item: {'review': "Packaging was excellent. The taste of the Biryani was on point. It wasn't too oily like most Biryanis usually are, so i will definitely order again! ", 'review_id': 284788233, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421} 2025-03-12 09:38:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21131421&page=1> {'review': "Packaging was excellent. The taste of the Biryani was on point. It wasn't too oily like most Biryanis usually are, so i will definitely order again! ", 'review_id': 284788233, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421} 2025-03-12 09:38:51 [reviews] INFO: Scraped item: {'review': 'Chicken dry roast : very few pieces ( 4 ). Coating of flour is more and uneven. Not worth the high price. Pathetic. Biryani : Too much of Masala . Not at all good. Overall not worth it.', 'review_id': 284317870, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421} 2025-03-12 09:38:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21131421&page=1> {'review': 'Chicken dry roast : very few pieces ( 4 ). Coating of flour is more and uneven. Not worth the high price. Pathetic. Biryani : Too much of Masala . Not at all good. Overall not worth it.', 'review_id': 284317870, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421} 2025-03-12 09:38:51 [reviews] INFO: Scraped item: {'review': 'west of money, bakvas test and all ', 'review_id': 283773806, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421} 2025-03-12 09:38:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21131421&page=1> {'review': 'west of money, bakvas test and all ', 'review_id': 283773806, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421} 2025-03-12 09:38:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:38:55 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Khar', 'platform': 'zomato', 'res_id': 21144195, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772275, 'download_latency': 1.0256028175354004, 'depth': 0} 2025-03-12 09:38:55 [reviews] INFO: Scraped item: {'review': 'Items were missing in the package..had ordered an combo', 'review_id': 284914083, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Khar', 'platform': 'zomato', 'res_id': 21144195} 2025-03-12 09:38:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21144195&page=1> {'review': 'Items were missing in the package..had ordered an combo', 'review_id': 284914083, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Khar', 'platform': 'zomato', 'res_id': 21144195} 2025-03-12 09:38:55 [reviews] INFO: Scraped item: {'review': 'No salt in fried rice', 'review_id': 284743549, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Khar', 'platform': 'zomato', 'res_id': 21144195} 2025-03-12 09:38:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21144195&page=1> {'review': 'No salt in fried rice', 'review_id': 284743549, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Khar', 'platform': 'zomato', 'res_id': 21144195} 2025-03-12 09:38:55 [reviews] INFO: Stopping for res_id: 21144195 as reviews are older than 7 days. 2025-03-12 09:38:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-12 09:38:57 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-12 09:38:57 [scrapy.extensions.logstats] INFO: Crawled 188 pages (at 8 pages/min), scraped 593 items (at 24 items/min) 2025-03-12 09:38:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:38:59 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 21146712, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772279, 'download_latency': 0.8227288722991943, 'depth': 0} 2025-03-12 09:38:59 [reviews] INFO: Scraped item: {'review': 'not good ', 'review_id': 284829117, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 21146712} 2025-03-12 09:38:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21146712&page=1> {'review': 'not good ', 'review_id': 284829117, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 21146712} 2025-03-12 09:38:59 [reviews] INFO: Scraped item: {'review': "I generally like biryani here... but today's didn't like freshly made. rice is over cooked and chicken is more than rice. This time I'm not satisfied.", 'review_id': 284519586, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 21146712} 2025-03-12 09:38:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21146712&page=1> {'review': "I generally like biryani here... but today's didn't like freshly made. rice is over cooked and chicken is more than rice. This time I'm not satisfied.", 'review_id': 284519586, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 21146712} 2025-03-12 09:38:59 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284338462, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 21146712} 2025-03-12 09:38:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21146712&page=1> {'review': '', 'review_id': 284338462, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 21146712} 2025-03-12 09:38:59 [reviews] INFO: Stopping for res_id: 21146712 as reviews are older than 7 days. 2025-03-12 09:39:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:39:03 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772283, 'download_latency': 0.921586275100708, 'depth': 0} 2025-03-12 09:39:03 [reviews] INFO: Scraped item: {'review': '', 'review_id': 285024225, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450} 2025-03-12 09:39:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21227450&page=1> {'review': '', 'review_id': 285024225, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450} 2025-03-12 09:39:03 [reviews] INFO: Scraped item: {'review': 'this restaurant gave me more then expectations the food quality and quantity and taste everything is awesome better luck next time ', 'review_id': 284901062, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450} 2025-03-12 09:39:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21227450&page=1> {'review': 'this restaurant gave me more then expectations the food quality and quantity and taste everything is awesome better luck next time ', 'review_id': 284901062, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450} 2025-03-12 09:39:03 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284886306, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450} 2025-03-12 09:39:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21227450&page=1> {'review': '', 'review_id': 284886306, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450} 2025-03-12 09:39:03 [reviews] INFO: Scraped item: {'review': 'excellent packaging and good food quality ', 'review_id': 283854683, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450} 2025-03-12 09:39:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21227450&page=1> {'review': 'excellent packaging and good food quality ', 'review_id': 283854683, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450} 2025-03-12 09:39:03 [reviews] INFO: Scraped item: {'review': 'The mutton was undercooked.', 'review_id': 283527130, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450} 2025-03-12 09:39:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21227450&page=1> {'review': 'The mutton was undercooked.', 'review_id': 283527130, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450} 2025-03-12 09:39:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:39:07 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 21240266, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772287, 'download_latency': 0.8566319942474365, 'depth': 0} 2025-03-12 09:39:07 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284494941, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 21240266} 2025-03-12 09:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21240266&page=1> {'review': '', 'review_id': 284494941, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 21240266} 2025-03-12 09:39:07 [reviews] INFO: Scraped item: {'review': 'The chicken was raw', 'review_id': 284439958, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 21240266} 2025-03-12 09:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21240266&page=1> {'review': 'The chicken was raw', 'review_id': 284439958, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 21240266} 2025-03-12 09:39:07 [reviews] INFO: Scraped item: {'review': "It wasn't a biryani... just rice and chicken and that too chicken is under cooked ", 'review_id': 283738931, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 21240266} 2025-03-12 09:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21240266&page=1> {'review': "It wasn't a biryani... just rice and chicken and that too chicken is under cooked ", 'review_id': 283738931, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 21240266} 2025-03-12 09:39:07 [reviews] INFO: Stopping for res_id: 21240266 as reviews are older than 7 days. 2025-03-12 09:39:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:39:10 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772289, 'download_latency': 0.8306598663330078, 'depth': 0} 2025-03-12 09:39:10 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284986027, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546} 2025-03-12 09:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21264546&page=1> {'review': '', 'review_id': 284986027, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546} 2025-03-12 09:39:10 [reviews] INFO: Scraped item: {'review': 'Can improve the dish', 'review_id': 284383524, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546} 2025-03-12 09:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21264546&page=1> {'review': 'Can improve the dish', 'review_id': 284383524, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546} 2025-03-12 09:39:10 [reviews] INFO: Scraped item: {'review': 'Angoori Rabri very poor taste', 'review_id': 284280896, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546} 2025-03-12 09:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21264546&page=1> {'review': 'Angoori Rabri very poor taste', 'review_id': 284280896, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546} 2025-03-12 09:39:10 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283303429, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546} 2025-03-12 09:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21264546&page=1> {'review': '', 'review_id': 283303429, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546} 2025-03-12 09:39:10 [reviews] INFO: Stopping for res_id: 21264546 as reviews are older than 7 days. 2025-03-12 09:39:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:39:13 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772293, 'download_latency': 0.8145751953125, 'depth': 0} 2025-03-12 09:39:13 [reviews] INFO: Scraped item: {'review': 'very less quantity of sweets. Quality average.

dhokla sandwich was old and not fresh.

tiramisu rasmalai quantity very less. Not worth the price ', 'review_id': 285053657, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729} 2025-03-12 09:39:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21275729&page=1> {'review': 'very less quantity of sweets. Quality average.

dhokla sandwich was old and not fresh.

tiramisu rasmalai quantity very less. Not worth the price ', 'review_id': 285053657, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729} 2025-03-12 09:39:13 [reviews] INFO: Scraped item: {'review': "The quantity was really less and also it's not the same as it is supposed to be. We've had from this place a lot many times but today was very poor quality", 'review_id': 283680541, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729} 2025-03-12 09:39:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21275729&page=1> {'review': "The quantity was really less and also it's not the same as it is supposed to be. We've had from this place a lot many times but today was very poor quality", 'review_id': 283680541, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729} 2025-03-12 09:39:13 [reviews] INFO: Scraped item: {'review': 'EXCELLENT TASTE', 'review_id': 283397289, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729} 2025-03-12 09:39:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21275729&page=1> {'review': 'EXCELLENT TASTE', 'review_id': 283397289, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729} 2025-03-12 09:39:13 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283342278, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729} 2025-03-12 09:39:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21275729&page=1> {'review': '', 'review_id': 283342278, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729} 2025-03-12 09:39:13 [reviews] INFO: Scraped item: {'review': "the kachori was very soggy. it felt like I was eating a stuffed puri.
the jalebis were crunchy but there was sourness in its taste and it wasn't sweet enough.
I expected a better experience for the price that I paid", 'review_id': 283193873, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729} 2025-03-12 09:39:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21275729&page=1> {'review': "the kachori was very soggy. it felt like I was eating a stuffed puri.
the jalebis were crunchy but there was sourness in its taste and it wasn't sweet enough.
I expected a better experience for the price that I paid", 'review_id': 283193873, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729} 2025-03-12 09:39:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:39:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:39:23 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:39:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:39:30 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:39:34 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:39:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:39:39 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Navi Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21330620, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772321, 'download_latency': 1.7412595748901367, 'depth': 0} 2025-03-12 09:39:39 [reviews] INFO: Stopping for res_id: 21330620 as reviews are older than 7 days. 2025-03-12 09:39:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:39:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:39:49 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:39:52 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:39:56 [scrapy.extensions.logstats] INFO: Crawled 194 pages (at 6 pages/min), scraped 613 items (at 20 items/min) 2025-03-12 09:39:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:39:57 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 74, 'brand_name': "Good Flippin' Burgers", 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 21363127, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772339, 'download_latency': 0.9471242427825928, 'depth': 0} 2025-03-12 09:39:57 [reviews] INFO: Scraped item: {'review': "asked for well done patty . it wasn't. sorry bad taste. ", 'review_id': 284083764, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 74, 'brand_name': "Good Flippin' Burgers", 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 21363127} 2025-03-12 09:39:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21363127&page=1> {'review': "asked for well done patty . it wasn't. sorry bad taste. ", 'review_id': 284083764, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 74, 'brand_name': "Good Flippin' Burgers", 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 21363127} 2025-03-12 09:39:57 [reviews] INFO: Scraped item: {'review': 'Atleast share napkins !! sauce and the like !', 'review_id': 283990634, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 74, 'brand_name': "Good Flippin' Burgers", 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 21363127} 2025-03-12 09:39:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21363127&page=1> {'review': 'Atleast share napkins !! sauce and the like !', 'review_id': 283990634, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 74, 'brand_name': "Good Flippin' Burgers", 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 21363127} 2025-03-12 09:39:57 [reviews] INFO: Scraped item: {'review': 'It was the best wings I had', 'review_id': 283800935, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 74, 'brand_name': "Good Flippin' Burgers", 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 21363127} 2025-03-12 09:39:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21363127&page=1> {'review': 'It was the best wings I had', 'review_id': 283800935, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 74, 'brand_name': "Good Flippin' Burgers", 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 21363127} 2025-03-12 09:39:57 [reviews] INFO: Scraped item: {'review': 'too small ', 'review_id': 283771894, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 74, 'brand_name': "Good Flippin' Burgers", 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 21363127} 2025-03-12 09:39:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21363127&page=1> {'review': 'too small ', 'review_id': 283771894, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 74, 'brand_name': "Good Flippin' Burgers", 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 21363127} 2025-03-12 09:39:57 [reviews] INFO: Stopping for res_id: 21363127 as reviews are older than 7 days. 2025-03-12 09:40:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:40:01 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21393822, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772343, 'download_latency': 0.8020713329315186, 'depth': 0} 2025-03-12 09:40:01 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284612635, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21393822} 2025-03-12 09:40:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21393822&page=1> {'review': '', 'review_id': 284612635, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21393822} 2025-03-12 09:40:01 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284202260, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21393822} 2025-03-12 09:40:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21393822&page=1> {'review': '', 'review_id': 284202260, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21393822} 2025-03-12 09:40:01 [reviews] INFO: Scraped item: {'review': 'Must try :) great place for dessert', 'review_id': 283494220, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21393822} 2025-03-12 09:40:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21393822&page=1> {'review': 'Must try :) great place for dessert', 'review_id': 283494220, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21393822} 2025-03-12 09:40:01 [reviews] INFO: Scraped item: {'review': 'Delivery came too late. Ice cream was melted.', 'review_id': 283441543, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21393822} 2025-03-12 09:40:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21393822&page=1> {'review': 'Delivery came too late. Ice cream was melted.', 'review_id': 283441543, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21393822} 2025-03-12 09:40:01 [reviews] INFO: Stopping for res_id: 21393822 as reviews are older than 7 days. 2025-03-12 09:40:05 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:40:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:40:09 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21395028, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772351, 'download_latency': 0.9239623546600342, 'depth': 0} 2025-03-12 09:40:09 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284305329, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21395028} 2025-03-12 09:40:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21395028&page=1> {'review': '', 'review_id': 284305329, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21395028} 2025-03-12 09:40:09 [reviews] INFO: Scraped item: {'review': 'quantity can be improved ', 'review_id': 284167551, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21395028} 2025-03-12 09:40:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21395028&page=1> {'review': 'quantity can be improved ', 'review_id': 284167551, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21395028} 2025-03-12 09:40:09 [reviews] INFO: Scraped item: {'review': 'Lovely packaging. Great food.', 'review_id': 283568254, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21395028} 2025-03-12 09:40:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21395028&page=1> {'review': 'Lovely packaging. Great food.', 'review_id': 283568254, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21395028} 2025-03-12 09:40:09 [reviews] INFO: Stopping for res_id: 21395028 as reviews are older than 7 days. 2025-03-12 09:40:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:40:12 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '4 Bungalows', 'platform': 'zomato', 'res_id': 21401321, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772354, 'download_latency': 0.7758853435516357, 'depth': 0} 2025-03-12 09:40:12 [reviews] ERROR: Error parsing date: an hour ago, error: unsupported type for timedelta hours component: NoneType 2025-03-12 09:40:12 [reviews] INFO: Stopping for res_id: 21401321 due to unrecognized date format: an hour ago. 2025-03-12 09:40:15 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:40:19 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:40:23 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:40:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:40:32 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:40:35 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:40:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:40:40 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 25, 'brand_name': "Veronica's", 'city': 'Mumbai', 'sub_zone': 'Bandra East', 'platform': 'zomato', 'res_id': 21432852, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772379, 'download_latency': 0.6580712795257568, 'depth': 0} 2025-03-12 09:40:40 [reviews] INFO: Stopping for res_id: 21432852 as reviews are older than 7 days. 2025-03-12 09:40:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:40:45 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:40:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:40:49 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 37, 'brand_name': 'Blue Tokai Coffee Roasters', 'city': 'Bangalore', 'sub_zone': 'Lavelle Road', 'platform': 'zomato', 'res_id': 21462394, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772389, 'download_latency': 0.8929259777069092, 'depth': 0} 2025-03-12 09:40:49 [reviews] INFO: Stopping for res_id: 21462394 as reviews are older than 7 days. 2025-03-12 09:40:53 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:40:56 [scrapy.extensions.logstats] INFO: Crawled 200 pages (at 6 pages/min), scraped 624 items (at 11 items/min) 2025-03-12 09:40:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:40:56 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772398, 'download_latency': 0.7668883800506592, 'depth': 0} 2025-03-12 09:40:56 [reviews] INFO: Scraped item: {'review': "The biryani wasn't fresh and smelled stale. I had to throw the entire food", 'review_id': 284513630, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794} 2025-03-12 09:40:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21503794&page=1> {'review': "The biryani wasn't fresh and smelled stale. I had to throw the entire food", 'review_id': 284513630, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794} 2025-03-12 09:40:56 [reviews] INFO: Scraped item: {'review': "I didn't like the taste. felt compromised", 'review_id': 284384274, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794} 2025-03-12 09:40:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21503794&page=1> {'review': "I didn't like the taste. felt compromised", 'review_id': 284384274, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794} 2025-03-12 09:40:56 [reviews] INFO: Scraped item: {'review': 'Biryani was burnt and also handi broken', 'review_id': 283823601, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794} 2025-03-12 09:40:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21503794&page=1> {'review': 'Biryani was burnt and also handi broken', 'review_id': 283823601, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794} 2025-03-12 09:40:56 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283813776, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794} 2025-03-12 09:40:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21503794&page=1> {'review': '', 'review_id': 283813776, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794} 2025-03-12 09:40:56 [reviews] INFO: Scraped item: {'review': 'Egg Biryani was extra cooked and burnt', 'review_id': 283758008, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794} 2025-03-12 09:40:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21503794&page=1> {'review': 'Egg Biryani was extra cooked and burnt', 'review_id': 283758008, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794} 2025-03-12 09:41:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:41:00 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 29, 'brand_name': 'abCoffee', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21514302, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772401, 'download_latency': 0.7889876365661621, 'depth': 0} 2025-03-12 09:41:00 [reviews] INFO: Scraped item: {'review': 'Sandwich was good but the size is not promising not sufficient for one', 'review_id': 284640555, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 29, 'brand_name': 'abCoffee', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21514302} 2025-03-12 09:41:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21514302&page=1> {'review': 'Sandwich was good but the size is not promising not sufficient for one', 'review_id': 284640555, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-10', 'competitor_id': 29, 'brand_name': 'abCoffee', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21514302} 2025-03-12 09:41:00 [reviews] INFO: Stopping for res_id: 21514302 as reviews are older than 7 days. 2025-03-12 09:41:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:41:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:41:06 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772410, 'download_latency': 0.7033326625823975, 'depth': 0} 2025-03-12 09:41:06 [reviews] INFO: Scraped item: {'review': 'Not at all upto the hype.It is just a hype normal cafes food is more tasty than this', 'review_id': 285247095, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-12', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554} 2025-03-12 09:41:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21528554&page=1> {'review': 'Not at all upto the hype.It is just a hype normal cafes food is more tasty than this', 'review_id': 285247095, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-12', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554} 2025-03-12 09:41:06 [reviews] INFO: Scraped item: {'review': 'The food didn’t meet the expectations at all. We ordered french toast it is not at all cooked from inside.
.The spanish omlette was very salty,avocado toast was very less in quantity for the price.
Overall bad experience for every food served.', 'review_id': 285246180, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-12', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554} 2025-03-12 09:41:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21528554&page=1> {'review': 'The food didn’t meet the expectations at all. We ordered french toast it is not at all cooked from inside.
.The spanish omlette was very salty,avocado toast was very less in quantity for the price.
Overall bad experience for every food served.', 'review_id': 285246180, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-12', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554} 2025-03-12 09:41:06 [reviews] INFO: Scraped item: {'review': 'Good outdoor seating.
They have vegan option as well.
Iced mocha with almond milk
Fresh orange juice', 'review_id': 285201550, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554} 2025-03-12 09:41:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21528554&page=1> {'review': 'Good outdoor seating.
They have vegan option as well.
Iced mocha with almond milk
Fresh orange juice', 'review_id': 285201550, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-11', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554} 2025-03-12 09:41:06 [reviews] INFO: Scraped item: {'review': '', 'review_id': 285122498, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554} 2025-03-12 09:41:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21528554&page=1> {'review': '', 'review_id': 285122498, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554} 2025-03-12 09:41:06 [reviews] INFO: Scraped item: {'review': 'Burger combo 4/5
pizza - 3/5
Ginger tofu cashew rice bowl - 2/5
Pasta 4/5
passion fruit juice 5/5

must try:
Sundae
', 'review_id': 284372715, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554} 2025-03-12 09:41:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21528554&page=1> {'review': 'Burger combo 4/5
pizza - 3/5
Ginger tofu cashew rice bowl - 2/5
Pasta 4/5
passion fruit juice 5/5

must try:
Sundae
', 'review_id': 284372715, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554} 2025-03-12 09:41:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:41:09 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 33, 'brand_name': 'Nandan Coffee', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21565814, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772412, 'download_latency': 0.6089489459991455, 'depth': 0} 2025-03-12 09:41:09 [reviews] INFO: Scraped item: {'review': "Didn't like it at all. I ordered hot chocolate but the taste was no where near to a hot chocolate", 'review_id': 285010986, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 33, 'brand_name': 'Nandan Coffee', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21565814} 2025-03-12 09:41:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21565814&page=1> {'review': "Didn't like it at all. I ordered hot chocolate but the taste was no where near to a hot chocolate", 'review_id': 285010986, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 33, 'brand_name': 'Nandan Coffee', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21565814} 2025-03-12 09:41:13 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:41:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:41:20 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:41:24 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:41:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:41:28 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 21568377, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772432, 'download_latency': 0.7535898685455322, 'depth': 0} 2025-03-12 09:41:28 [reviews] INFO: Scraped item: {'review': '', 'review_id': 285131079, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 21568377} 2025-03-12 09:41:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21568377&page=1> {'review': '', 'review_id': 285131079, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-11', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 21568377} 2025-03-12 09:41:28 [reviews] INFO: Scraped item: {'review': '. ', 'review_id': 283212028, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 21568377} 2025-03-12 09:41:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21568377&page=1> {'review': '. ', 'review_id': 283212028, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 21568377} 2025-03-12 09:41:28 [reviews] INFO: Stopping for res_id: 21568377 as reviews are older than 7 days. 2025-03-12 09:41:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-12 09:41:31 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 27, 'brand_name': 'Grey Soul Coffee Roasters', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 21575164, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741772436, 'download_latency': 0.7306690216064453, 'depth': 0} 2025-03-12 09:41:31 [reviews] INFO: Scraped item: {'review': 'The shakerato was so so bad and not even cold and when we sent it back it came back as it is and we just had to leave after paying for the coffee, had heard great things but really a very bad experience', 'review_id': 283987312, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 27, 'brand_name': 'Grey Soul Coffee Roasters', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 21575164} 2025-03-12 09:41:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21575164&page=1> {'review': 'The shakerato was so so bad and not even cold and when we sent it back it came back as it is and we just had to leave after paying for the coffee, had heard great things but really a very bad experience', 'review_id': 283987312, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 27, 'brand_name': 'Grey Soul Coffee Roasters', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 21575164} 2025-03-12 09:41:31 [reviews] INFO: Scraped item: {'review': 'Amazing food plating, quality and taste. Grounded ambiance making it perfect for a slow day. Coffee is amazing and the service is swift as well. 10/10 recommended.', 'review_id': 283614347, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 27, 'brand_name': 'Grey Soul Coffee Roasters', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 21575164} 2025-03-12 09:41:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21575164&page=1> {'review': 'Amazing food plating, quality and taste. Grounded ambiance making it perfect for a slow day. Coffee is amazing and the service is swift as well. 10/10 recommended.', 'review_id': 283614347, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 27, 'brand_name': 'Grey Soul Coffee Roasters', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 21575164} 2025-03-12 09:41:31 [reviews] INFO: Scraped item: {'review': 'So I visited based off my friend recommendation who stays close this cafe. To my surprise everything was perfect the service, the quantity of food and of course the coffee as they are roasters ! Got myself a bag of coffee for my home espresso on the way out.', 'review_id': 283611292, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 27, 'brand_name': 'Grey Soul Coffee Roasters', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 21575164} 2025-03-12 09:41:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21575164&page=1> {'review': 'So I visited based off my friend recommendation who stays close this cafe. To my surprise everything was perfect the service, the quantity of food and of course the coffee as they are roasters ! Got myself a bag of coffee for my home espresso on the way out.', 'review_id': 283611292, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 27, 'brand_name': 'Grey Soul Coffee Roasters', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 21575164} 2025-03-12 09:41:31 [reviews] INFO: Stopping for res_id: 21575164 as reviews are older than 7 days. 2025-03-12 09:41:34 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:41:39 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:41:43 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:41:47 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:41:52 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:41:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:41:56 [scrapy.extensions.logstats] INFO: Crawled 206 pages (at 6 pages/min), scraped 641 items (at 17 items/min) 2025-03-12 09:41:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:42:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:42:04 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:42:08 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:42:11 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:42:15 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:42:19 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:42:23 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:42:27 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:42:30 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:42:34 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:42:38 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:42:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:42:45 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:42:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:42:53 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:42:56 [scrapy.extensions.logstats] INFO: Crawled 206 pages (at 0 pages/min), scraped 641 items (at 0 items/min) 2025-03-12 09:42:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:43:01 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:43:04 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:43:08 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:43:10 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:43:15 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:43:19 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:43:23 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-12 09:43:23 [scrapy.core.engine] INFO: Closing spider (finished) 2025-03-12 09:43:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): cron.restaverse.com:443 2025-03-12 09:43:24 [urllib3.connectionpool] DEBUG: https://cron.restaverse.com:443 "POST /insert_data/ HTTP/11" 201 112 2025-03-12 09:43:24 [reviews] INFO: Data posted successfully. 2025-03-12 09:43:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-12 09:43:25 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-12 09:43:25 [scrapy.statscollectors] INFO: Dumping Scrapy stats: {'downloader/exception_count': 528, 'downloader/exception_type_count/scrapy.core.downloader.handlers.http11.TunnelError': 527, 'downloader/exception_type_count/twisted.internet.error.TimeoutError': 1, 'downloader/request_bytes': 663455, 'downloader/request_count': 734, 'downloader/request_method_count/GET': 734, 'downloader/response_bytes': 1045518, 'downloader/response_count': 206, 'downloader/response_status_count/200': 205, 'downloader/response_status_count/400': 1, 'elapsed_time_seconds': 2668.345477, 'finish_reason': 'finished', 'finish_time': datetime.datetime(2025, 3, 12, 9, 43, 24, 831903, tzinfo=datetime.timezone.utc), 'httpcompression/response_bytes': 1937652, 'httpcompression/response_count': 205, 'item_scraped_count': 641, 'items_per_minute': None, 'log_count/DEBUG': 1360, 'log_count/ERROR': 100, 'log_count/INFO': 1017, 'memusage/max': 78184448, 'memusage/startup': 65290240, 'request_depth_max': 1, 'response_received_count': 206, 'responses_per_minute': None, 'retry/count': 440, 'retry/max_reached': 88, 'retry/reason_count/scrapy.core.downloader.handlers.http11.TunnelError': 439, 'retry/reason_count/twisted.internet.error.TimeoutError': 1, 'scheduler/dequeued': 734, 'scheduler/dequeued/memory': 734, 'scheduler/enqueued': 734, 'scheduler/enqueued/memory': 734, 'start_time': datetime.datetime(2025, 3, 12, 8, 58, 56, 486426, tzinfo=datetime.timezone.utc)} 2025-03-12 09:43:25 [scrapy.core.engine] INFO: Spider closed (finished)