2025-03-03 00:30:06 [scrapy.utils.log] INFO: Scrapy 2.12.0 started (bot: zomato_competiton_analysis)
2025-03-03 00:30:06 [scrapy.utils.log] INFO: Versions: lxml 5.3.0.0, libxml2 2.12.9, cssselect 1.2.0, parsel 1.9.1, w3lib 2.2.1, Twisted 24.11.0, Python 3.10.12 (main, Feb  4 2025, 14:57:36) [GCC 11.4.0], pyOpenSSL 24.3.0 (OpenSSL 3.4.0 22 Oct 2024), cryptography 44.0.0, Platform Linux-6.8.0-1015-aws-aarch64-with-glibc2.35
2025-03-03 00:30:06 [scrapy.addons] INFO: Enabled addons:
[]
2025-03-03 00:30:06 [asyncio] DEBUG: Using selector: EpollSelector
2025-03-03 00:30:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2025-03-03 00:30:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2025-03-03 00:30:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2025-03-03 00:30:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2025-03-03 00:30:06 [scrapy.extensions.telnet] INFO: Telnet Password: 7ecc66a676ce9e18
2025-03-03 00:30:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.logstats.LogStats',
 'scrapeops_scrapy.extension.ScrapeOpsMonitor']
2025-03-03 00:30:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'zomato_competiton_analysis',
 'DOWNLOAD_DELAY': 3,
 'DOWNLOAD_TIMEOUT': 30,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/home/ubuntu/restaverse_spiders/logs/zomato_competiton_analysis/reviews/zomato '
             'competitor analysis reviws_2025-03-03T00_30_02.log',
 'NEWSPIDER_MODULE': 'zomato_competiton_analysis.spiders',
 'RETRY_HTTP_CODES': [500, 502, 503, 504, 408],
 'RETRY_TIMES': 5,
 'SPIDER_MODULES': ['zomato_competiton_analysis.spiders'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor'}
2025-03-03 00:30:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapeops_scrapy.middleware.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2025-03-03 00:30:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware']
2025-03-03 00:30:06 [scrapy.middleware] INFO: Enabled item pipelines:
['zomato_competiton_analysis.pipelines.ZomatoCompetionAnalysisPipeline']
2025-03-03 00:30:06 [scrapy.core.engine] INFO: Spider opened
2025-03-03 00:30:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2025-03-03 00:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2025-03-03 00:30:07 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/setup/ HTTP/11" 200 None
2025-03-03 00:30:07 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2025-03-03 00:30:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): cron.restaverse.com:443
2025-03-03 00:30:17 [urllib3.connectionpool] DEBUG: https://cron.restaverse.com:443 "POST /api/db_services/fetch-query HTTP/11" 200 28263
2025-03-03 00:30:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2025-03-03 00:30:17 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/normalizer/proxy_port/?job_id=3459683 HTTP/11" 200 None
2025-03-03 00:30:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2025-03-03 00:30:18 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/normalizer/domain/?domain=zomato.com HTTP/11" 200 241
2025-03-03 00:30:20 [scrapy.core.engine] DEBUG: Crawled (400) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=0&page=1> (referer: None)
2025-03-03 00:30:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2025-03-03 00:30:21 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108
2025-03-03 00:30:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=947&page=1> (referer: None)
2025-03-03 00:30:23 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740961819, 'download_latency': 0.6728684902191162, 'depth': 0}
2025-03-03 00:30:23 [reviews] INFO: Scraped item: {'review': 'Excellent service by Parag!!', 'review_id': 280941944, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-02-27', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947}
2025-03-03 00:30:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=947&page=1>
{'review': 'Excellent service by Parag!!', 'review_id': 280941944, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-02-27', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947}
2025-03-03 00:30:23 [reviews] INFO: Scraped item: {'review': 'Always coming here for Asian Small Bites. The Menu is perfect for someone who likes it spicy! Good spread. The service is top notch too, Parag had been really helpful and hospital. Kudos to the team!', 'review_id': 280699954, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-02-27', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947}
2025-03-03 00:30:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=947&page=1>
{'review': 'Always coming here for Asian Small Bites. The Menu is perfect for someone who likes it spicy! Good spread. The service is top notch too, Parag had been really helpful and hospital. Kudos to the team!', 'review_id': 280699954, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-02-27', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947}
2025-03-03 00:30:23 [reviews] INFO: Scraped item: {'review': 'Today good was really amazing. Thanks.', 'review_id': 280490317, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947}
2025-03-03 00:30:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=947&page=1>
{'review': 'Today good was really amazing. Thanks.', 'review_id': 280490317, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947}
2025-03-03 00:30:23 [reviews] INFO: Stopping for res_id: 947 as reviews are older than 7 days.
2025-03-03 00:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32835&page=1> (referer: None)
2025-03-03 00:30:27 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740961819, 'download_latency': 0.6395621299743652, 'depth': 0}
2025-03-03 00:30:27 [reviews] INFO: Scraped item: {'review': 'Mawa firni was not delivered with he food, very disappointed with the service, the order was delivered half and hour late, plus the phirni wat we had paid for was not included in the order even after paying for it', 'review_id': 282024845, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835}
2025-03-03 00:30:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32835&page=1>
{'review': 'Mawa firni was not delivered with he food, very disappointed with the service, the order was delivered half and hour late, plus the phirni wat we had paid for was not included in the order even after paying for it', 'review_id': 282024845, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835}
2025-03-03 00:30:27 [reviews] INFO: Scraped item: {'review': 'Too poor in timely delivery .... pathetic delivery timelines', 'review_id': 282011470, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835}
2025-03-03 00:30:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32835&page=1>
{'review': 'Too poor in timely delivery .... pathetic delivery timelines', 'review_id': 282011470, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835}
2025-03-03 00:30:27 [reviews] INFO: Scraped item: {'review': 'chicken kolhapuri was very spicy ', 'review_id': 281983807, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835}
2025-03-03 00:30:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32835&page=1>
{'review': 'chicken kolhapuri was very spicy ', 'review_id': 281983807, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835}
2025-03-03 00:30:27 [reviews] INFO: Scraped item: {'review': '40 mins delayed', 'review_id': 281846859, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835}
2025-03-03 00:30:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32835&page=1>
{'review': '40 mins delayed', 'review_id': 281846859, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835}
2025-03-03 00:30:27 [reviews] INFO: Scraped item: {'review': 'the mutton chaap was half cooked only please cooked it completely next time', 'review_id': 281835827, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835}
2025-03-03 00:30:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32835&page=1>
{'review': 'the mutton chaap was half cooked only please cooked it completely next time', 'review_id': 281835827, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835}
2025-03-03 00:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32971&page=1> (referer: None)
2025-03-03 00:30:31 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 32971, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740961819, 'download_latency': 0.714860200881958, 'depth': 0}
2025-03-03 00:30:31 [reviews] INFO: Scraped item: {'review': 'Dilip was a great server. The place was very clean and service and food was amazing', 'review_id': 281779403, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 32971}
2025-03-03 00:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32971&page=1>
{'review': 'Dilip was a great server. The place was very clean and service and food was amazing', 'review_id': 281779403, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 32971}
2025-03-03 00:30:31 [reviews] INFO: Scraped item: {'review': "O didn't like the butter chicken, big chinks if chicken and gravy was more like a regular spicy curry and not creamy like butter chicken is supposed it be like. Very disappointed", 'review_id': 281237347, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 32971}
2025-03-03 00:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32971&page=1>
{'review': "O didn't like the butter chicken, big chinks if chicken and gravy was more like a regular spicy curry and not creamy like butter chicken is supposed it be like. Very disappointed", 'review_id': 281237347, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 32971}
2025-03-03 00:30:31 [reviews] INFO: Scraped item: {'review': 'excellent as always ', 'review_id': 281130230, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 32971}
2025-03-03 00:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32971&page=1>
{'review': 'excellent as always ', 'review_id': 281130230, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 32971}
2025-03-03 00:30:31 [reviews] INFO: Scraped item: {'review': 'super taste', 'review_id': 281100373, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 32971}
2025-03-03 00:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32971&page=1>
{'review': 'super taste', 'review_id': 281100373, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 32971}
2025-03-03 00:30:31 [reviews] INFO: Scraped item: {'review': 'The tikka were dry and not as per regular order.  The portion was so 5 pcs avant- regular 6. This was 1+1', 'review_id': 281066805, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 32971}
2025-03-03 00:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32971&page=1>
{'review': 'The tikka were dry and not as per regular order.  The portion was so 5 pcs avant- regular 6. This was 1+1', 'review_id': 281066805, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 32971}
2025-03-03 00:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34052&page=1> (referer: None)
2025-03-03 00:30:35 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740961819, 'download_latency': 0.6235964298248291, 'depth': 0}
2025-03-03 00:30:35 [reviews] INFO: Scraped item: {'review': 'not do good', 'review_id': 282272840, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052}
2025-03-03 00:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34052&page=1>
{'review': 'not do good', 'review_id': 282272840, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052}
2025-03-03 00:30:35 [reviews] INFO: Scraped item: {'review': '', 'review_id': 282256778, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052}
2025-03-03 00:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34052&page=1>
{'review': '', 'review_id': 282256778, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052}
2025-03-03 00:30:35 [reviews] INFO: Scraped item: {'review': 'Food quality too bad', 'review_id': 282241115, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052}
2025-03-03 00:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34052&page=1>
{'review': 'Food quality too bad', 'review_id': 282241115, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052}
2025-03-03 00:30:35 [reviews] INFO: Scraped item: {'review': 'The restaurant gives a percel without a carry bag ,if they are giving like this so they have to inform im advance', 'review_id': 282235529, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052}
2025-03-03 00:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34052&page=1>
{'review': 'The restaurant gives a percel without a carry bag ,if they are giving like this so they have to inform im advance', 'review_id': 282235529, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052}
2025-03-03 00:30:35 [reviews] INFO: Scraped item: {'review': 'mixed chicken pieces were there. few were cooked and many were very hard to chew.not able to eat properly. worried about health issues of my kids who ate these undercooked chicken.Need compensation, every time you people just blame it on restaurant. we trust zomato so we order through your app, we can directly call hotel n order, why to use zomato. Plz Stop fooling people. do justice. it has happened several times, but no response from you', 'review_id': 282226678, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052}
2025-03-03 00:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34052&page=1>
{'review': 'mixed chicken pieces were there. few were cooked and many were very hard to chew.not able to eat properly. worried about health issues of my kids who ate these undercooked chicken.Need compensation, every time you people just blame it on restaurant. we trust zomato so we order through your app, we can directly call hotel n order, why to use zomato. Plz Stop fooling people. do justice. it has happened several times, but no response from you', 'review_id': 282226678, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052}
2025-03-03 00:30:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2025-03-03 00:30:36 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108
2025-03-03 00:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34157&page=1> (referer: None)
2025-03-03 00:30:39 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740961819, 'download_latency': 0.7694211006164551, 'depth': 0}
2025-03-03 00:30:39 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281784404, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157}
2025-03-03 00:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34157&page=1>
{'review': '', 'review_id': 281784404, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157}
2025-03-03 00:30:39 [reviews] INFO: Scraped item: {'review': 'The soup was super oily', 'review_id': 281589039, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157}
2025-03-03 00:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34157&page=1>
{'review': 'The soup was super oily', 'review_id': 281589039, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157}
2025-03-03 00:30:39 [reviews] INFO: Scraped item: {'review': 'Food come with lot of black colour on it', 'review_id': 281488844, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157}
2025-03-03 00:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34157&page=1>
{'review': 'Food come with lot of black colour on it', 'review_id': 281488844, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157}
2025-03-03 00:30:39 [reviews] INFO: Scraped item: {'review': 'We informed for less spicy soup.. still it was spicy.. chicken coriander soup. Just warm water', 'review_id': 281445070, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157}
2025-03-03 00:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34157&page=1>
{'review': 'We informed for less spicy soup.. still it was spicy.. chicken coriander soup. Just warm water', 'review_id': 281445070, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157}
2025-03-03 00:30:39 [reviews] INFO: Scraped item: {'review': 'no taste.', 'review_id': 280796224, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157}
2025-03-03 00:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34157&page=1>
{'review': 'no taste.', 'review_id': 280796224, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157}
2025-03-03 00:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34269&page=1> (referer: None)
2025-03-03 00:30:43 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740961819, 'download_latency': 0.6751203536987305, 'depth': 0}
2025-03-03 00:30:43 [reviews] INFO: Scraped item: {'review': 'Mutton biryani has only bones no mutton <br/>Taste is pathetic and expensive not worth it at all , no value for money neither the taste ', 'review_id': 282243979, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269}
2025-03-03 00:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34269&page=1>
{'review': 'Mutton biryani has only bones no mutton <br/>Taste is pathetic and expensive not worth it at all , no value for money neither the taste ', 'review_id': 282243979, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269}
2025-03-03 00:30:43 [reviews] INFO: Scraped item: {'review': 'nice taste ', 'review_id': 282197108, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269}
2025-03-03 00:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34269&page=1>
{'review': 'nice taste ', 'review_id': 282197108, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269}
2025-03-03 00:30:43 [reviews] INFO: Scraped item: {'review': 'was not fresh', 'review_id': 282169695, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269}
2025-03-03 00:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34269&page=1>
{'review': 'was not fresh', 'review_id': 282169695, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269}
2025-03-03 00:30:43 [reviews] INFO: Scraped item: {'review': 'Delicious!!', 'review_id': 282112677, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269}
2025-03-03 00:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34269&page=1>
{'review': 'Delicious!!', 'review_id': 282112677, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269}
2025-03-03 00:30:43 [reviews] INFO: Scraped item: {'review': 'the masala chana and masala aloo quantity left a lot to be desired not even half the container bhai ramzan hai thoda dhyan rakho', 'review_id': 282064592, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269}
2025-03-03 00:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34269&page=1>
{'review': 'the masala chana and masala aloo quantity left a lot to be desired not even half the container bhai ramzan hai thoda dhyan rakho', 'review_id': 282064592, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269}
2025-03-03 00:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34410&page=1> (referer: None)
2025-03-03 00:30:47 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 0, 'brand_name': 'Kailash Parbat ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 34410, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740961819, 'download_latency': 0.7014217376708984, 'depth': 0}
2025-03-03 00:30:47 [reviews] INFO: Scraped item: {'review': 'A DIFFRRENT TWIST TO ORIGINAL RAGDA PATTICE...WILL HAVE TO CULTIVATE TASTE', 'review_id': 281908723, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 0, 'brand_name': 'Kailash Parbat ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 34410}
2025-03-03 00:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34410&page=1>
{'review': 'A DIFFRRENT TWIST TO ORIGINAL RAGDA PATTICE...WILL HAVE TO CULTIVATE TASTE', 'review_id': 281908723, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 0, 'brand_name': 'Kailash Parbat ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 34410}
2025-03-03 00:30:47 [reviews] INFO: Scraped item: {'review': 'add some more vegetables in veg biryani ', 'review_id': 281548835, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 0, 'brand_name': 'Kailash Parbat ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 34410}
2025-03-03 00:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34410&page=1>
{'review': 'add some more vegetables in veg biryani ', 'review_id': 281548835, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 0, 'brand_name': 'Kailash Parbat ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 34410}
2025-03-03 00:30:47 [reviews] INFO: Scraped item: {'review': 'service fast,quality too good ,packaging very nice, test amazing 👌🏻👌🏻', 'review_id': 280921885, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 0, 'brand_name': 'Kailash Parbat ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 34410}
2025-03-03 00:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34410&page=1>
{'review': 'service fast,quality too good ,packaging very nice, test amazing 👌🏻👌🏻', 'review_id': 280921885, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 0, 'brand_name': 'Kailash Parbat ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 34410}
2025-03-03 00:30:47 [reviews] INFO: Scraped item: {'review': '', 'review_id': 280179944, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 0, 'brand_name': 'Kailash Parbat ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 34410}
2025-03-03 00:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34410&page=1>
{'review': '', 'review_id': 280179944, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 0, 'brand_name': 'Kailash Parbat ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 34410}
2025-03-03 00:30:47 [reviews] INFO: Stopping for res_id: 34410 as reviews are older than 7 days.
2025-03-03 00:30:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2025-03-03 00:30:52 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108
2025-03-03 00:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34777&page=1> (referer: None)
2025-03-03 00:30:52 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740961819, 'download_latency': 1.3656814098358154, 'depth': 0}
2025-03-03 00:30:52 [reviews] INFO: Scraped item: {'review': 'Inspite of requesting less spicy, I was sent a very spicy meal. ', 'review_id': 281947891, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777}
2025-03-03 00:30:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34777&page=1>
{'review': 'Inspite of requesting less spicy, I was sent a very spicy meal. ', 'review_id': 281947891, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777}
2025-03-03 00:30:52 [reviews] INFO: Scraped item: {'review': 'did not respect my request to make the dish spicy.', 'review_id': 281768807, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777}
2025-03-03 00:30:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34777&page=1>
{'review': 'did not respect my request to make the dish spicy.', 'review_id': 281768807, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777}
2025-03-03 00:30:52 [reviews] INFO: Scraped item: {'review': 'Best Chinese food', 'review_id': 281187334, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777}
2025-03-03 00:30:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34777&page=1>
{'review': 'Best Chinese food', 'review_id': 281187334, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777}
2025-03-03 00:30:52 [reviews] INFO: Scraped item: {'review': 'Very less Quantity ', 'review_id': 281127070, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777}
2025-03-03 00:30:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34777&page=1>
{'review': 'Very less Quantity ', 'review_id': 281127070, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777}
2025-03-03 00:30:52 [reviews] INFO: Scraped item: {'review': '', 'review_id': 280537544, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777}
2025-03-03 00:30:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34777&page=1>
{'review': '', 'review_id': 280537544, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777}
2025-03-03 00:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34810&page=1> (referer: None)
2025-03-03 00:30:55 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 73, 'brand_name': 'Fire Bowl', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 34810, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740961819, 'download_latency': 0.6718540191650391, 'depth': 0}
2025-03-03 00:30:55 [reviews] INFO: Scraped item: {'review': 'very little paner and vv spicy', 'review_id': 281586236, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 73, 'brand_name': 'Fire Bowl', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 34810}
2025-03-03 00:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34810&page=1>
{'review': 'very little paner and vv spicy', 'review_id': 281586236, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 73, 'brand_name': 'Fire Bowl', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 34810}
2025-03-03 00:30:55 [reviews] INFO: Scraped item: {'review': 'Wish i could rate it lower, crispy chicken ( i doubt)  was horrible', 'review_id': 281287376, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 73, 'brand_name': 'Fire Bowl', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 34810}
2025-03-03 00:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34810&page=1>
{'review': 'Wish i could rate it lower, crispy chicken ( i doubt)  was horrible', 'review_id': 281287376, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 73, 'brand_name': 'Fire Bowl', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 34810}
2025-03-03 00:30:55 [reviews] INFO: Scraped item: {'review': '', 'review_id': 280898899, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 73, 'brand_name': 'Fire Bowl', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 34810}
2025-03-03 00:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34810&page=1>
{'review': '', 'review_id': 280898899, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 73, 'brand_name': 'Fire Bowl', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 34810}
2025-03-03 00:30:55 [reviews] INFO: Scraped item: {'review': 'Very very bad chicken lollipop no test no chicken only arraroat', 'review_id': 280495598, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 73, 'brand_name': 'Fire Bowl', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 34810}
2025-03-03 00:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34810&page=1>
{'review': 'Very very bad chicken lollipop no test no chicken only arraroat', 'review_id': 280495598, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 73, 'brand_name': 'Fire Bowl', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 34810}
2025-03-03 00:30:55 [reviews] INFO: Scraped item: {'review': 'super spicy, soggy noddles, I received paneer gravy instead of crispy paneer ', 'review_id': 280174281, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 73, 'brand_name': 'Fire Bowl', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 34810}
2025-03-03 00:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34810&page=1>
{'review': 'super spicy, soggy noddles, I received paneer gravy instead of crispy paneer ', 'review_id': 280174281, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 73, 'brand_name': 'Fire Bowl', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 34810}
2025-03-03 00:30:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34844&page=1> (referer: None)
2025-03-03 00:30:59 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740961819, 'download_latency': 0.693734884262085, 'depth': 0}
2025-03-03 00:30:59 [reviews] INFO: Scraped item: {'review': '', 'review_id': 282213738, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844}
2025-03-03 00:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34844&page=1>
{'review': '', 'review_id': 282213738, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844}
2025-03-03 00:30:59 [reviews] INFO: Scraped item: {'review': "Didn't expect this very bad", 'review_id': 282080006, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844}
2025-03-03 00:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34844&page=1>
{'review': "Didn't expect this very bad", 'review_id': 282080006, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844}
2025-03-03 00:30:59 [reviews] INFO: Scraped item: {'review': 'reverb of the restaurant very gud', 'review_id': 282037136, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844}
2025-03-03 00:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34844&page=1>
{'review': 'reverb of the restaurant very gud', 'review_id': 282037136, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844}
2025-03-03 00:30:59 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281976786, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844}
2025-03-03 00:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34844&page=1>
{'review': '', 'review_id': 281976786, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844}
2025-03-03 00:30:59 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281933712, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844}
2025-03-03 00:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34844&page=1>
{'review': '', 'review_id': 281933712, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844}
2025-03-03 00:31:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36164&page=1> (referer: None)
2025-03-03 00:31:03 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 0, 'brand_name': 'New yorker', 'city': 'Mumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 36164, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740961819, 'download_latency': 0.620880126953125, 'depth': 0}
2025-03-03 00:31:03 [reviews] INFO: Scraped item: {'review': "The Panini didn't taste good. The vegetables were tasting stale. Couldn't eat more than a bite. That food item & money literally went waste. But the rest of the dishes were very good. !!!", 'review_id': 280386836, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 0, 'brand_name': 'New yorker', 'city': 'Mumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 36164}
2025-03-03 00:31:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36164&page=1>
{'review': "The Panini didn't taste good. The vegetables were tasting stale. Couldn't eat more than a bite. That food item & money literally went waste. But the rest of the dishes were very good. !!!", 'review_id': 280386836, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 0, 'brand_name': 'New yorker', 'city': 'Mumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 36164}
2025-03-03 00:31:03 [reviews] INFO: Stopping for res_id: 36164 as reviews are older than 7 days.
2025-03-03 00:31:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2025-03-03 00:31:06 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108
2025-03-03 00:31:06 [scrapy.extensions.logstats] INFO: Crawled 12 pages (at 12 pages/min), scraped 48 items (at 48 items/min)
2025-03-03 00:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36226&page=1> (referer: None)
2025-03-03 00:31:08 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 61, 'brand_name': "Mom's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 36226, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740961819, 'download_latency': 0.635246753692627, 'depth': 0}
2025-03-03 00:31:08 [reviews] INFO: Scraped item: {'review': 'there was no salt added in the soup .', 'review_id': 282275524, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 61, 'brand_name': "Mom's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 36226}
2025-03-03 00:31:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36226&page=1>
{'review': 'there was no salt added in the soup .', 'review_id': 282275524, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 61, 'brand_name': "Mom's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 36226}
2025-03-03 00:31:08 [reviews] INFO: Scraped item: {'review': 'Soup is worst', 'review_id': 280525092, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 61, 'brand_name': "Mom's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 36226}
2025-03-03 00:31:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36226&page=1>
{'review': 'Soup is worst', 'review_id': 280525092, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 61, 'brand_name': "Mom's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 36226}
2025-03-03 00:31:08 [reviews] INFO: Stopping for res_id: 36226 as reviews are older than 7 days.
2025-03-03 00:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36291&page=1> (referer: None)
2025-03-03 00:31:12 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740961819, 'download_latency': 0.665848970413208, 'depth': 0}
2025-03-03 00:31:12 [reviews] INFO: Scraped item: {'review': 'Received buns with tampered expiry dates—original date overwritten with a pen. This is unsafe and unacceptable. Please take action."', 'review_id': 281984607, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291}
2025-03-03 00:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36291&page=1>
{'review': 'Received buns with tampered expiry dates—original date overwritten with a pen. This is unsafe and unacceptable. Please take action."', 'review_id': 281984607, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291}
2025-03-03 00:31:12 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281983859, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291}
2025-03-03 00:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36291&page=1>
{'review': '', 'review_id': 281983859, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291}
2025-03-03 00:31:12 [reviews] INFO: Scraped item: {'review': '', 'review_id': 280860580, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291}
2025-03-03 00:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36291&page=1>
{'review': '', 'review_id': 280860580, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291}
2025-03-03 00:31:12 [reviews] INFO: Scraped item: {'review': '', 'review_id': 280143756, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291}
2025-03-03 00:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36291&page=1>
{'review': '', 'review_id': 280143756, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291}
2025-03-03 00:31:12 [reviews] INFO: Stopping for res_id: 36291 as reviews are older than 7 days.
2025-03-03 00:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37459&page=1> (referer: None)
2025-03-03 00:31:16 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 9, 'brand_name': 'Status', 'city': 'Mumbai', 'sub_zone': 'Nariman Point', 'platform': 'zomato', 'res_id': 37459, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740961819, 'download_latency': 0.7319867610931396, 'depth': 0}
2025-03-03 00:31:16 [reviews] INFO: Stopping for res_id: 37459 as reviews are older than 7 days.
2025-03-03 00:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37679&page=1> (referer: None)
2025-03-03 00:31:20 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740961819, 'download_latency': 0.6446001529693604, 'depth': 0}
2025-03-03 00:31:20 [reviews] INFO: Scraped item: {'review': 'The food at cream centre has always been very good - our server Rajkishoer was very sweet and very good. Service was quick and fast- definitely a must try restaurant in Mumbai', 'review_id': 282198761, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679}
2025-03-03 00:31:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37679&page=1>
{'review': 'The food at cream centre has always been very good - our server Rajkishoer was very sweet and very good. Service was quick and fast- definitely a must try restaurant in Mumbai', 'review_id': 282198761, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679}
2025-03-03 00:31:20 [reviews] INFO: Scraped item: {'review': 'Have a wonderful experience and thanks to the staff member Ali akhtar for hospitality. ', 'review_id': 282077564, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679}
2025-03-03 00:31:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37679&page=1>
{'review': 'Have a wonderful experience and thanks to the staff member Ali akhtar for hospitality. ', 'review_id': 282077564, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679}
2025-03-03 00:31:20 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281990962, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679}
2025-03-03 00:31:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37679&page=1>
{'review': '', 'review_id': 281990962, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679}
2025-03-03 00:31:20 [reviews] INFO: Scraped item: {'review': 'The food is always delicious, and the service is excellent. Our waiter, Negi, was exceptionally polite and friendly.', 'review_id': 281814112, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679}
2025-03-03 00:31:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37679&page=1>
{'review': 'The food is always delicious, and the service is excellent. Our waiter, Negi, was exceptionally polite and friendly.', 'review_id': 281814112, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679}
2025-03-03 00:31:20 [reviews] INFO: Scraped item: {'review': 'Prasad shelke good server', 'review_id': 281807966, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679}
2025-03-03 00:31:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37679&page=1>
{'review': 'Prasad shelke good server', 'review_id': 281807966, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679}
2025-03-03 00:31:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2025-03-03 00:31:21 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108
2025-03-03 00:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37823&page=1> (referer: None)
2025-03-03 00:31:23 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740961820, 'download_latency': 0.8078992366790771, 'depth': 0}
2025-03-03 00:31:23 [reviews] INFO: Scraped item: {'review': 'Rice were very bland and dry', 'review_id': 281863444, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823}
2025-03-03 00:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37823&page=1>
{'review': 'Rice were very bland and dry', 'review_id': 281863444, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823}
2025-03-03 00:31:23 [reviews] INFO: Scraped item: {'review': 'worst experience', 'review_id': 281494757, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823}
2025-03-03 00:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37823&page=1>
{'review': 'worst experience', 'review_id': 281494757, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823}
2025-03-03 00:31:23 [reviews] INFO: Scraped item: {'review': 'pathetic 😡 restless garlic burt rice. Waste of money vegetables are not fresh... rice is not cooked properly... I think they have packed leftover rice ', 'review_id': 281433645, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823}
2025-03-03 00:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37823&page=1>
{'review': 'pathetic 😡 restless garlic burt rice. Waste of money vegetables are not fresh... rice is not cooked properly... I think they have packed leftover rice ', 'review_id': 281433645, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823}
2025-03-03 00:31:23 [reviews] INFO: Scraped item: {'review': 'Chicken fried rice was too blunt with very less veggies. Chicken 5 spice noddles was made very sour', 'review_id': 281121464, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823}
2025-03-03 00:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37823&page=1>
{'review': 'Chicken fried rice was too blunt with very less veggies. Chicken 5 spice noddles was made very sour', 'review_id': 281121464, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823}
2025-03-03 00:31:23 [reviews] INFO: Stopping for res_id: 37823 as reviews are older than 7 days.
2025-03-03 00:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37978&page=1> (referer: None)
2025-03-03 00:31:27 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 0, 'brand_name': 'Relish', 'city': 'Mumbai', 'sub_zone': 'Churchgate', 'platform': 'zomato', 'res_id': 37978, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740961824, 'download_latency': 0.7229259014129639, 'depth': 0}
2025-03-03 00:31:27 [reviews] INFO: Stopping for res_id: 37978 as reviews are older than 7 days.
2025-03-03 00:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=38512&page=1> (referer: None)
2025-03-03 00:31:29 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 64, 'brand_name': "Jim - Me's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Hill Road ', 'platform': 'zomato', 'res_id': 38512, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740961827, 'download_latency': 0.6267893314361572, 'depth': 0}
2025-03-03 00:31:29 [reviews] INFO: Scraped item: {'review': 'l', 'review_id': 281437067, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 64, 'brand_name': "Jim - Me's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Hill Road ', 'platform': 'zomato', 'res_id': 38512}
2025-03-03 00:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=38512&page=1>
{'review': 'l', 'review_id': 281437067, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 64, 'brand_name': "Jim - Me's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Hill Road ', 'platform': 'zomato', 'res_id': 38512}
2025-03-03 00:31:29 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281289099, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 64, 'brand_name': "Jim - Me's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Hill Road ', 'platform': 'zomato', 'res_id': 38512}
2025-03-03 00:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=38512&page=1>
{'review': '', 'review_id': 281289099, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 64, 'brand_name': "Jim - Me's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Hill Road ', 'platform': 'zomato', 'res_id': 38512}
2025-03-03 00:31:29 [reviews] INFO: Stopping for res_id: 38512 as reviews are older than 7 days.
2025-03-03 00:31:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32835&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:31:35 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32971&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2025-03-03 00:31:36 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108
2025-03-03 00:31:38 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34052&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:31:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34157&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:31:44 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34269&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:31:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=38797&page=1> (referer: None)
2025-03-03 00:31:47 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 69, 'brand_name': 'Asian Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 38797, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740961852, 'download_latency': 0.6642303466796875, 'depth': 0}
2025-03-03 00:31:47 [reviews] INFO: Stopping for res_id: 38797 as reviews are older than 7 days.
2025-03-03 00:31:51 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34777&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:31:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2025-03-03 00:31:52 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108
2025-03-03 00:31:55 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34810&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:31:59 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34844&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=39528&page=1> (referer: None)
2025-03-03 00:32:03 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'PHOENIX', 'platform': 'zomato', 'res_id': 39528, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740961868, 'download_latency': 0.7088749408721924, 'depth': 0}
2025-03-03 00:32:03 [reviews] INFO: Stopping for res_id: 39528 as reviews are older than 7 days.
2025-03-03 00:32:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2025-03-03 00:32:07 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108
2025-03-03 00:32:07 [scrapy.extensions.logstats] INFO: Crawled 21 pages (at 9 pages/min), scraped 65 items (at 17 items/min)
2025-03-03 00:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=39675&page=1> (referer: None)
2025-03-03 00:32:07 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 39, 'brand_name': 'Yauatcha', 'city': 'Mumbai', 'sub_zone': 'Bandra Kurla Complex', 'platform': 'zomato', 'res_id': 39675, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740961872, 'download_latency': 0.6306207180023193, 'depth': 0}
2025-03-03 00:32:07 [reviews] INFO: Scraped item: {'review': 'Saif had really recommended us good food and good service..Thankyou for hosting us well', 'review_id': 282204853, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 39, 'brand_name': 'Yauatcha', 'city': 'Mumbai', 'sub_zone': 'Bandra Kurla Complex', 'platform': 'zomato', 'res_id': 39675}
2025-03-03 00:32:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=39675&page=1>
{'review': 'Saif had really recommended us good food and good service..Thankyou for hosting us well', 'review_id': 282204853, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 39, 'brand_name': 'Yauatcha', 'city': 'Mumbai', 'sub_zone': 'Bandra Kurla Complex', 'platform': 'zomato', 'res_id': 39675}
2025-03-03 00:32:07 [reviews] INFO: Scraped item: {'review': 'Really good food. Saif was very helpful and made the experience great for us.', 'review_id': 282147554, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 39, 'brand_name': 'Yauatcha', 'city': 'Mumbai', 'sub_zone': 'Bandra Kurla Complex', 'platform': 'zomato', 'res_id': 39675}
2025-03-03 00:32:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=39675&page=1>
{'review': 'Really good food. Saif was very helpful and made the experience great for us.', 'review_id': 282147554, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 39, 'brand_name': 'Yauatcha', 'city': 'Mumbai', 'sub_zone': 'Bandra Kurla Complex', 'platform': 'zomato', 'res_id': 39675}
2025-03-03 00:32:07 [reviews] INFO: Scraped item: {'review': 'Very oily food. Have been here multiple times but today it tasted like a glorified chowmein stall.', 'review_id': 280243201, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-02-25', 'competitor_id': 39, 'brand_name': 'Yauatcha', 'city': 'Mumbai', 'sub_zone': 'Bandra Kurla Complex', 'platform': 'zomato', 'res_id': 39675}
2025-03-03 00:32:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=39675&page=1>
{'review': 'Very oily food. Have been here multiple times but today it tasted like a glorified chowmein stall.', 'review_id': 280243201, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-02-25', 'competitor_id': 39, 'brand_name': 'Yauatcha', 'city': 'Mumbai', 'sub_zone': 'Bandra Kurla Complex', 'platform': 'zomato', 'res_id': 39675}
2025-03-03 00:32:07 [reviews] INFO: Stopping for res_id: 39675 as reviews are older than 7 days.
2025-03-03 00:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=40083&page=1> (referer: None)
2025-03-03 00:32:10 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740961877, 'download_latency': 0.6544370651245117, 'depth': 0}
2025-03-03 00:32:10 [reviews] INFO: Scraped item: {'review': 'it is not chopper rice...it is normal fried rice ', 'review_id': 282239630, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083}
2025-03-03 00:32:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=40083&page=1>
{'review': 'it is not chopper rice...it is normal fried rice ', 'review_id': 282239630, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083}
2025-03-03 00:32:10 [reviews] INFO: Scraped item: {'review': 'Order same Paneer Chilly 2 times but difference in quantity ', 'review_id': 282143118, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083}
2025-03-03 00:32:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=40083&page=1>
{'review': 'Order same Paneer Chilly 2 times but difference in quantity ', 'review_id': 282143118, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083}
2025-03-03 00:32:10 [reviews] INFO: Scraped item: {'review': 'taste less and very salty 🤮', 'review_id': 281843566, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083}
2025-03-03 00:32:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=40083&page=1>
{'review': 'taste less and very salty 🤮', 'review_id': 281843566, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083}
2025-03-03 00:32:10 [reviews] INFO: Scraped item: {'review': 'nice test ', 'review_id': 281153807, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083}
2025-03-03 00:32:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=40083&page=1>
{'review': 'nice test ', 'review_id': 281153807, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083}
2025-03-03 00:32:10 [reviews] INFO: Scraped item: {'review': 'too salty.. stale chicken', 'review_id': 280860707, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083}
2025-03-03 00:32:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=40083&page=1>
{'review': 'too salty.. stale chicken', 'review_id': 280860707, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083}
2025-03-03 00:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=41143&page=1> (referer: None)
2025-03-03 00:32:15 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740961880, 'download_latency': 0.6461997032165527, 'depth': 0}
2025-03-03 00:32:15 [reviews] INFO: Scraped item: {'review': 'the did not send the vinegar sauce which i had instructed ', 'review_id': 282219136, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143}
2025-03-03 00:32:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=41143&page=1>
{'review': 'the did not send the vinegar sauce which i had instructed ', 'review_id': 282219136, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143}
2025-03-03 00:32:15 [reviews] INFO: Scraped item: {'review': 'incorrect order received after 1hr of wait. I placed and paid for an order of veg Schezwan fried rice. I received veg noodles. Rubbish service. cannot see the order and package details before sending for delivery.', 'review_id': 282209289, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143}
2025-03-03 00:32:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=41143&page=1>
{'review': 'incorrect order received after 1hr of wait. I placed and paid for an order of veg Schezwan fried rice. I received veg noodles. Rubbish service. cannot see the order and package details before sending for delivery.', 'review_id': 282209289, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143}
2025-03-03 00:32:15 [reviews] INFO: Scraped item: {'review': 'Way too much oil in the food ...', 'review_id': 282103694, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143}
2025-03-03 00:32:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=41143&page=1>
{'review': 'Way too much oil in the food ...', 'review_id': 282103694, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143}
2025-03-03 00:32:15 [reviews] INFO: Scraped item: {'review': '', 'review_id': 282054974, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143}
2025-03-03 00:32:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=41143&page=1>
{'review': '', 'review_id': 282054974, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143}
2025-03-03 00:32:15 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281466770, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143}
2025-03-03 00:32:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=41143&page=1>
{'review': '', 'review_id': 281466770, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143}
2025-03-03 00:32:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37679&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:32:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=42630&page=1> (referer: None)
2025-03-03 00:32:24 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 63, 'brand_name': 'Cocoon- Dragonfly Hotel', 'city': 'Mumbai', 'sub_zone': 'Chakala', 'platform': 'zomato', 'res_id': 42630, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740961887, 'download_latency': 2.3019776344299316, 'depth': 0}
2025-03-03 00:32:24 [reviews] INFO: Stopping for res_id: 42630 as reviews are older than 7 days.
2025-03-03 00:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=42695&page=1> (referer: None)
2025-03-03 00:32:27 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 66, 'brand_name': 'Red Chilli', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 42695, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740961889, 'download_latency': 0.967902660369873, 'depth': 0}
2025-03-03 00:32:27 [reviews] INFO: Scraped item: {'review': '', 'review_id': 280538556, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 66, 'brand_name': 'Red Chilli', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 42695}
2025-03-03 00:32:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=42695&page=1>
{'review': '', 'review_id': 280538556, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 66, 'brand_name': 'Red Chilli', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 42695}
2025-03-03 00:32:27 [reviews] INFO: Stopping for res_id: 42695 as reviews are older than 7 days.
2025-03-03 00:32:29 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32835&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:32:33 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32971&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:32:35 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34052&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:32:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2025-03-03 00:32:36 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108
2025-03-03 00:32:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34157&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:32:43 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34269&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=43965&page=1> (referer: None)
2025-03-03 00:32:46 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'RCITY', 'platform': 'zomato', 'res_id': 43965, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740961907, 'download_latency': 1.306349754333496, 'depth': 0}
2025-03-03 00:32:46 [reviews] INFO: Scraped item: {'review': 'Chana masala was awesome', 'review_id': 282240870, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'RCITY', 'platform': 'zomato', 'res_id': 43965}
2025-03-03 00:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=43965&page=1>
{'review': 'Chana masala was awesome', 'review_id': 282240870, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'RCITY', 'platform': 'zomato', 'res_id': 43965}
2025-03-03 00:32:46 [reviews] INFO: Scraped item: {'review': 'authentic food', 'review_id': 282238071, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'RCITY', 'platform': 'zomato', 'res_id': 43965}
2025-03-03 00:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=43965&page=1>
{'review': 'authentic food', 'review_id': 282238071, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'RCITY', 'platform': 'zomato', 'res_id': 43965}
2025-03-03 00:32:46 [reviews] INFO: Scraped item: {'review': 'food was excellent ', 'review_id': 282235435, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'RCITY', 'platform': 'zomato', 'res_id': 43965}
2025-03-03 00:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=43965&page=1>
{'review': 'food was excellent ', 'review_id': 282235435, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'RCITY', 'platform': 'zomato', 'res_id': 43965}
2025-03-03 00:32:46 [reviews] INFO: Scraped item: {'review': 'food was very yummy and service was excellent ', 'review_id': 282170269, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'RCITY', 'platform': 'zomato', 'res_id': 43965}
2025-03-03 00:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=43965&page=1>
{'review': 'food was very yummy and service was excellent ', 'review_id': 282170269, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'RCITY', 'platform': 'zomato', 'res_id': 43965}
2025-03-03 00:32:46 [reviews] INFO: Scraped item: {'review': 'food was awesome ', 'review_id': 282135955, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'RCITY', 'platform': 'zomato', 'res_id': 43965}
2025-03-03 00:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=43965&page=1>
{'review': 'food was awesome ', 'review_id': 282135955, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'RCITY', 'platform': 'zomato', 'res_id': 43965}
2025-03-03 00:32:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34777&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:32:51 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34810&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:32:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34844&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:32:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=46672&page=1> (referer: None)
2025-03-03 00:33:00 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740961924, 'download_latency': 1.381594181060791, 'depth': 0}
2025-03-03 00:33:00 [reviews] INFO: Scraped item: {'review': 'It’s a great place for food with great ambiance, best service , love to come again', 'review_id': 282246672, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672}
2025-03-03 00:33:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=46672&page=1>
{'review': 'It’s a great place for food with great ambiance, best service , love to come again', 'review_id': 282246672, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672}
2025-03-03 00:33:00 [reviews] INFO: Scraped item: {'review': 'Mr Anoop Yadav was the captain for the table.. he served well', 'review_id': 282234305, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672}
2025-03-03 00:33:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=46672&page=1>
{'review': 'Mr Anoop Yadav was the captain for the table.. he served well', 'review_id': 282234305, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672}
2025-03-03 00:33:00 [reviews] INFO: Scraped item: {'review': 'very quick service given by Mr.Anil Kumar , he is very n fast , all foods were very yummy ', 'review_id': 282212367, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672}
2025-03-03 00:33:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=46672&page=1>
{'review': 'very quick service given by Mr.Anil Kumar , he is very n fast , all foods were very yummy ', 'review_id': 282212367, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672}
2025-03-03 00:33:00 [reviews] INFO: Scraped item: {'review': 'The service was amazing especially by Anoop Yadav', 'review_id': 282206218, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672}
2025-03-03 00:33:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=46672&page=1>
{'review': 'The service was amazing especially by Anoop Yadav', 'review_id': 282206218, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672}
2025-03-03 00:33:00 [reviews] INFO: Scraped item: {'review': 'Anoop Yadav best', 'review_id': 282203249, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672}
2025-03-03 00:33:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=46672&page=1>
{'review': 'Anoop Yadav best', 'review_id': 282203249, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672}
2025-03-03 00:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47111&page=1> (referer: None)
2025-03-03 00:33:04 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 26, 'brand_name': 'Starbucks Coffee', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 47111, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740961928, 'download_latency': 1.2365784645080566, 'depth': 0}
2025-03-03 00:33:04 [reviews] INFO: Stopping for res_id: 47111 as reviews are older than 7 days.
2025-03-03 00:33:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2025-03-03 00:33:06 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108
2025-03-03 00:33:06 [scrapy.extensions.logstats] INFO: Crawled 29 pages (at 8 pages/min), scraped 89 items (at 24 items/min)
2025-03-03 00:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47171&page=1> (referer: None)
2025-03-03 00:33:08 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740961931, 'download_latency': 1.3621842861175537, 'depth': 0}
2025-03-03 00:33:08 [reviews] INFO: Scraped item: {'review': 'amazing food', 'review_id': 282134220, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171}
2025-03-03 00:33:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47171&page=1>
{'review': 'amazing food', 'review_id': 282134220, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171}
2025-03-03 00:33:08 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281589278, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171}
2025-03-03 00:33:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47171&page=1>
{'review': '', 'review_id': 281589278, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171}
2025-03-03 00:33:08 [reviews] INFO: Scraped item: {'review': 'found a cockroach in the Veg Pot Rice', 'review_id': 281269634, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171}
2025-03-03 00:33:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47171&page=1>
{'review': 'found a cockroach in the Veg Pot Rice', 'review_id': 281269634, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171}
2025-03-03 00:33:08 [reviews] INFO: Scraped item: {'review': "hot and sour soup was too spicy....couldn't hav it", 'review_id': 280824062, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171}
2025-03-03 00:33:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47171&page=1>
{'review': "hot and sour soup was too spicy....couldn't hav it", 'review_id': 280824062, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171}
2025-03-03 00:33:08 [reviews] INFO: Scraped item: {'review': "The rice was uncooked. I couldn't even completely eat the portion. It's the first time such a thing has happened. Really Disappointed ☹️", 'review_id': 280326110, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171}
2025-03-03 00:33:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47171&page=1>
{'review': "The rice was uncooked. I couldn't even completely eat the portion. It's the first time such a thing has happened. Really Disappointed ☹️", 'review_id': 280326110, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171}
2025-03-03 00:33:09 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=40083&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:33:13 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=41143&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:33:17 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37679&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:33:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47458&page=1> (referer: None)
2025-03-03 00:33:19 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740961947, 'download_latency': 1.031930923461914, 'depth': 0}
2025-03-03 00:33:19 [reviews] INFO: Scraped item: {'review': 'DO NOT ORDER FROM THIS RESTAURANT...3rd class food... waste of money.. overhyped for no reason ', 'review_id': 282273430, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458}
2025-03-03 00:33:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47458&page=1>
{'review': 'DO NOT ORDER FROM THIS RESTAURANT...3rd class food... waste of money.. overhyped for no reason ', 'review_id': 282273430, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458}
2025-03-03 00:33:19 [reviews] INFO: Scraped item: {'review': '', 'review_id': 282245665, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458}
2025-03-03 00:33:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47458&page=1>
{'review': '', 'review_id': 282245665, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458}
2025-03-03 00:33:19 [reviews] INFO: Scraped item: {'review': 'Keep the door closed \U0001fae0', 'review_id': 282219771, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458}
2025-03-03 00:33:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47458&page=1>
{'review': 'Keep the door closed \U0001fae0', 'review_id': 282219771, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458}
2025-03-03 00:33:19 [reviews] INFO: Scraped item: {'review': 'na', 'review_id': 282158588, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458}
2025-03-03 00:33:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47458&page=1>
{'review': 'na', 'review_id': 282158588, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458}
2025-03-03 00:33:19 [reviews] INFO: Scraped item: {'review': 'Mashallah alhamdulillah Persian darbar. Has ability for wonderful cooking. Amazing food. I love to eat always. From Persian. Darbar. Lovely. Yummy. Authentic food. Alhamdulillah ❤️❤️❤️🍲🍲🍲❤️❤️❤️❤️', 'review_id': 281872099, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458}
2025-03-03 00:33:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47458&page=1>
{'review': 'Mashallah alhamdulillah Persian darbar. Has ability for wonderful cooking. Amazing food. I love to eat always. From Persian. Darbar. Lovely. Yummy. Authentic food. Alhamdulillah ❤️❤️❤️🍲🍲🍲❤️❤️❤️❤️', 'review_id': 281872099, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458}
2025-03-03 00:33:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32835&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:33:26 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32971&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:33:30 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34052&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:33:34 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34157&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:33:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2025-03-03 00:33:36 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108
2025-03-03 00:33:38 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34269&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=48066&page=1> (referer: None)
2025-03-03 00:33:43 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Matunga East', 'platform': 'zomato', 'res_id': 48066, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740961967, 'download_latency': 1.0552000999450684, 'depth': 0}
2025-03-03 00:33:43 [reviews] ERROR: Unrecognized relative_date format: nov 18, 2022
2025-03-03 00:33:43 [reviews] INFO: Stopping for res_id: 48066 due to unrecognized date format: Nov 18, 2022.
2025-03-03 00:33:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=43965&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:33:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34810&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:33:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34844&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:33:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34777&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:34:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=46672&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:34:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2025-03-03 00:34:06 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108
2025-03-03 00:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=48323&page=1> (referer: None)
2025-03-03 00:34:06 [scrapy.extensions.logstats] INFO: Crawled 33 pages (at 4 pages/min), scraped 99 items (at 10 items/min)
2025-03-03 00:34:06 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740961988, 'download_latency': 1.536271333694458, 'depth': 0}
2025-03-03 00:34:06 [reviews] INFO: Scraped item: {'review': 'quality and quantity good', 'review_id': 282236062, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323}
2025-03-03 00:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=48323&page=1>
{'review': 'quality and quantity good', 'review_id': 282236062, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323}
2025-03-03 00:34:06 [reviews] INFO: Scraped item: {'review': 'Average taste', 'review_id': 282091075, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323}
2025-03-03 00:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=48323&page=1>
{'review': 'Average taste', 'review_id': 282091075, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323}
2025-03-03 00:34:06 [reviews] INFO: Scraped item: {'review': 'The food was good but the quantity was a bit less for the price some more quantity would be good also no salad such as onion raita etc and also some complimentary sweet would be good ', 'review_id': 281937593, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323}
2025-03-03 00:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=48323&page=1>
{'review': 'The food was good but the quantity was a bit less for the price some more quantity would be good also no salad such as onion raita etc and also some complimentary sweet would be good ', 'review_id': 281937593, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323}
2025-03-03 00:34:06 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281909873, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323}
2025-03-03 00:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=48323&page=1>
{'review': '', 'review_id': 281909873, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323}
2025-03-03 00:34:06 [reviews] INFO: Scraped item: {'review': 'Lehsuni kebab was good but biryani was below par, chicken pieces were very stiff and rice on top was dry and bland. Needs improvement', 'review_id': 281903336, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323}
2025-03-03 00:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=48323&page=1>
{'review': 'Lehsuni kebab was good but biryani was below par, chicken pieces were very stiff and rice on top was dry and bland. Needs improvement', 'review_id': 281903336, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323}
2025-03-03 00:34:09 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47171&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:34:13 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=41143&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:34:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=40083&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:34:19 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37679&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:34:23 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47458&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:34:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32971&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:34:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34052&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:34:34 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34157&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:34:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2025-03-03 00:34:36 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108
2025-03-03 00:34:37 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34269&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:34:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32835&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:34:45 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=43965&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:34:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34810&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:34:53 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34844&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:34:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34777&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:35:01 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=46672&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2025-03-03 00:35:06 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108
2025-03-03 00:35:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=48693&page=1> (referer: None)
2025-03-03 00:35:06 [scrapy.extensions.logstats] INFO: Crawled 34 pages (at 1 pages/min), scraped 104 items (at 5 items/min)
2025-03-03 00:35:07 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 70, 'brand_name': 'Wok Hei', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 48693, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962047, 'download_latency': 2.361225128173828, 'depth': 0}
2025-03-03 00:35:07 [reviews] INFO: Scraped item: {'review': 'Food quality is very good', 'review_id': 281096965, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-02-28', 'competitor_id': 70, 'brand_name': 'Wok Hei', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 48693}
2025-03-03 00:35:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=48693&page=1>
{'review': 'Food quality is very good', 'review_id': 281096965, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-02-28', 'competitor_id': 70, 'brand_name': 'Wok Hei', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 48693}
2025-03-03 00:35:07 [reviews] INFO: Scraped item: {'review': "Time and again, I keep running to Wok Hei for their momos. I used to always have momos from Wow Momos but after having momos from here, I do not know why I just don't order them from Wow Momos, it's not that I do not like Wow momos but something always makes me come to Wok Hei. As I was typing this review, I now know the reason, I think Wok Hei provides excellent stuffing for these momos compared to Wow Momos. I find it dense and I love they send it with multiple sauces. Overall I'm a huge fan of momos from Wok Hei. The Chicken Chilli Basil one is my all time favorite.☺️", 'review_id': 280792088, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 70, 'brand_name': 'Wok Hei', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 48693}
2025-03-03 00:35:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=48693&page=1>
{'review': "Time and again, I keep running to Wok Hei for their momos. I used to always have momos from Wow Momos but after having momos from here, I do not know why I just don't order them from Wow Momos, it's not that I do not like Wow momos but something always makes me come to Wok Hei. As I was typing this review, I now know the reason, I think Wok Hei provides excellent stuffing for these momos compared to Wow Momos. I find it dense and I love they send it with multiple sauces. Overall I'm a huge fan of momos from Wok Hei. The Chicken Chilli Basil one is my all time favorite.☺️", 'review_id': 280792088, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 70, 'brand_name': 'Wok Hei', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 48693}
2025-03-03 00:35:07 [reviews] INFO: Stopping for res_id: 48693 as reviews are older than 7 days.
2025-03-03 00:35:08 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=48323&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:35:12 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47171&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:35:15 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=40083&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:35:19 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=41143&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:35:23 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47458&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:35:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37679&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:35:31 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34052&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:35:34 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34157&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:35:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2025-03-03 00:35:36 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108
2025-03-03 00:35:38 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34269&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:35:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32835&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:35:44 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=43965&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:35:48 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34810&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:35:51 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34844&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:35:55 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34777&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:36:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=46672&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:36:04 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32971&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2025-03-03 00:36:06 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108
2025-03-03 00:36:06 [scrapy.extensions.logstats] INFO: Crawled 34 pages (at 0 pages/min), scraped 106 items (at 2 items/min)
2025-03-03 00:36:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=48323&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:36:10 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47171&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:36:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=40083&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:36:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=41143&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:36:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47458&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:36:25 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37679&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:36:29 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34052&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:36:32 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34157&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2025-03-03 00:36:36 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108
2025-03-03 00:36:37 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34269&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:36:39 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32835&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:36:44 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=43965&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:36:48 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34810&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:36:50 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34844&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:36:55 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34777&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:36:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=46672&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:37:02 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32971&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2025-03-03 00:37:06 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108
2025-03-03 00:37:06 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=48323&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:37:06 [scrapy.extensions.logstats] INFO: Crawled 34 pages (at 0 pages/min), scraped 106 items (at 0 items/min)
2025-03-03 00:37:09 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47171&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:37:12 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=40083&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:37:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=41143&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:37:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47458&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:37:22 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37679&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=49608&page=1> (referer: None)
2025-03-03 00:37:28 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962189, 'download_latency': 2.3314061164855957, 'depth': 0}
2025-03-03 00:37:28 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281579623, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608}
2025-03-03 00:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=49608&page=1>
{'review': '', 'review_id': 281579623, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608}
2025-03-03 00:37:28 [reviews] INFO: Scraped item: {'review': 'The soup was aweful. No prawns to be seen in thw wanton. One small minced piece that too extremely salty', 'review_id': 280942634, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608}
2025-03-03 00:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=49608&page=1>
{'review': 'The soup was aweful. No prawns to be seen in thw wanton. One small minced piece that too extremely salty', 'review_id': 280942634, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608}
2025-03-03 00:37:28 [reviews] INFO: Scraped item: {'review': '', 'review_id': 280646089, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608}
2025-03-03 00:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=49608&page=1>
{'review': '', 'review_id': 280646089, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608}
2025-03-03 00:37:28 [reviews] INFO: Scraped item: {'review': 'no Schezwan sauce added<br/>on rice<br/>', 'review_id': 280307514, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608}
2025-03-03 00:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=49608&page=1>
{'review': 'no Schezwan sauce added<br/>on rice<br/>', 'review_id': 280307514, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608}
2025-03-03 00:37:28 [reviews] INFO: Scraped item: {'review': '', 'review_id': 280238921, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608}
2025-03-03 00:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=49608&page=1>
{'review': '', 'review_id': 280238921, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608}
2025-03-03 00:37:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=306805&page=1> (referer: None)
2025-03-03 00:37:30 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962193, 'download_latency': 0.7973480224609375, 'depth': 0}
2025-03-03 00:37:30 [reviews] INFO: Scraped item: {'review': 'Only thought is that you should not make it so spicy. It was little too much.', 'review_id': 282215071, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805}
2025-03-03 00:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=306805&page=1>
{'review': 'Only thought is that you should not make it so spicy. It was little too much.', 'review_id': 282215071, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805}
2025-03-03 00:37:30 [reviews] INFO: Scraped item: {'review': 'Spilled', 'review_id': 281419178, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805}
2025-03-03 00:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=306805&page=1>
{'review': 'Spilled', 'review_id': 281419178, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805}
2025-03-03 00:37:30 [reviews] INFO: Scraped item: {'review': "finally a great place which doesn't throw insane spices into your favourite kebabs, but rather keeps them exceptionally tasty", 'review_id': 281175676, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805}
2025-03-03 00:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=306805&page=1>
{'review': "finally a great place which doesn't throw insane spices into your favourite kebabs, but rather keeps them exceptionally tasty", 'review_id': 281175676, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805}
2025-03-03 00:37:30 [reviews] INFO: Scraped item: {'review': 'the seekh kabab was hard and felt stale and the chicken pieces were very small, though the flavours were good but at this price point you expect the pieces to at least be of normal size of not big', 'review_id': 281000957, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805}
2025-03-03 00:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=306805&page=1>
{'review': 'the seekh kabab was hard and felt stale and the chicken pieces were very small, though the flavours were good but at this price point you expect the pieces to at least be of normal size of not big', 'review_id': 281000957, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805}
2025-03-03 00:37:30 [reviews] INFO: Scraped item: {'review': '', 'review_id': 280825033, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805}
2025-03-03 00:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=306805&page=1>
{'review': '', 'review_id': 280825033, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805}
2025-03-03 00:37:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=312995&page=1> (referer: None)
2025-03-03 00:37:32 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962197, 'download_latency': 0.7176456451416016, 'depth': 0}
2025-03-03 00:37:32 [reviews] INFO: Scraped item: {'review': 'The chicken was raw and uncooked', 'review_id': 282089966, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995}
2025-03-03 00:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=312995&page=1>
{'review': 'The chicken was raw and uncooked', 'review_id': 282089966, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995}
2025-03-03 00:37:32 [reviews] INFO: Scraped item: {'review': 'Kathal pcs were not fresh.', 'review_id': 282029925, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995}
2025-03-03 00:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=312995&page=1>
{'review': 'Kathal pcs were not fresh.', 'review_id': 282029925, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995}
2025-03-03 00:37:32 [reviews] INFO: Scraped item: {'review': 'Worst biryani.', 'review_id': 281146693, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995}
2025-03-03 00:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=312995&page=1>
{'review': 'Worst biryani.', 'review_id': 281146693, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995}
2025-03-03 00:37:32 [reviews] INFO: Scraped item: {'review': 'One of the worst biryanis ever had, horrible total waste of money', 'review_id': 281118069, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995}
2025-03-03 00:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=312995&page=1>
{'review': 'One of the worst biryanis ever had, horrible total waste of money', 'review_id': 281118069, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995}
2025-03-03 00:37:32 [reviews] INFO: Scraped item: {'review': 'not good', 'review_id': 281096920, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995}
2025-03-03 00:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=312995&page=1>
{'review': 'not good', 'review_id': 281096920, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995}
2025-03-03 00:37:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2025-03-03 00:37:36 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108
2025-03-03 00:37:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=17871363&page=1> (referer: None)
2025-03-03 00:37:37 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 40, 'brand_name': 'The Fatty Bao', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 17871363, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962200, 'download_latency': 0.690833568572998, 'depth': 0}
2025-03-03 00:37:37 [reviews] INFO: Scraped item: {'review': "sushi was absolutely dissapointing and didn't taste fresh", 'review_id': 280940962, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 40, 'brand_name': 'The Fatty Bao', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 17871363}
2025-03-03 00:37:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=17871363&page=1>
{'review': "sushi was absolutely dissapointing and didn't taste fresh", 'review_id': 280940962, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 40, 'brand_name': 'The Fatty Bao', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 17871363}
2025-03-03 00:37:37 [reviews] INFO: Scraped item: {'review': 'not worth for money ', 'review_id': 280697693, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 40, 'brand_name': 'The Fatty Bao', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 17871363}
2025-03-03 00:37:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=17871363&page=1>
{'review': 'not worth for money ', 'review_id': 280697693, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 40, 'brand_name': 'The Fatty Bao', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 17871363}
2025-03-03 00:37:37 [reviews] INFO: Scraped item: {'review': 'cheesecake, blackpepper sauce, teriyaki rice, and dinner corn chowder broth everything was fantastic! thank you.', 'review_id': 280696924, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 40, 'brand_name': 'The Fatty Bao', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 17871363}
2025-03-03 00:37:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=17871363&page=1>
{'review': 'cheesecake, blackpepper sauce, teriyaki rice, and dinner corn chowder broth everything was fantastic! thank you.', 'review_id': 280696924, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 40, 'brand_name': 'The Fatty Bao', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 17871363}
2025-03-03 00:37:37 [reviews] INFO: Scraped item: {'review': '', 'review_id': 280395318, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 40, 'brand_name': 'The Fatty Bao', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 17871363}
2025-03-03 00:37:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=17871363&page=1>
{'review': '', 'review_id': 280395318, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 40, 'brand_name': 'The Fatty Bao', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 17871363}
2025-03-03 00:37:37 [reviews] INFO: Stopping for res_id: 17871363 as reviews are older than 7 days.
2025-03-03 00:37:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=43965&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18161729&page=1> (referer: None)
2025-03-03 00:37:44 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 46, 'brand_name': 'China House - Hyatt Regency', 'city': 'Ahmedabad', 'sub_zone': 'Hyatt Regency, Ashram Road ', 'platform': 'zomato', 'res_id': 18161729, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962208, 'download_latency': 0.6724991798400879, 'depth': 0}
2025-03-03 00:37:44 [reviews] INFO: Stopping for res_id: 18161729 as reviews are older than 7 days.
2025-03-03 00:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18165909&page=1> (referer: None)
2025-03-03 00:37:48 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 18165909, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962211, 'download_latency': 0.8728804588317871, 'depth': 0}
2025-03-03 00:37:48 [reviews] INFO: Scraped item: {'review': 'the chicken 65 biryani was too dry and the taste was preety mehj', 'review_id': 281173049, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 18165909}
2025-03-03 00:37:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18165909&page=1>
{'review': 'the chicken 65 biryani was too dry and the taste was preety mehj', 'review_id': 281173049, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 18165909}
2025-03-03 00:37:48 [reviews] INFO: Scraped item: {'review': 'not fresh non authentic fast food biryani', 'review_id': 280115038, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 18165909}
2025-03-03 00:37:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18165909&page=1>
{'review': 'not fresh non authentic fast food biryani', 'review_id': 280115038, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 18165909}
2025-03-03 00:37:48 [reviews] INFO: Stopping for res_id: 18165909 as reviews are older than 7 days.
2025-03-03 00:37:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18216915&page=1> (referer: None)
2025-03-03 00:37:52 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962215, 'download_latency': 0.6946072578430176, 'depth': 0}
2025-03-03 00:37:52 [reviews] INFO: Scraped item: {'review': 'very nice❤️', 'review_id': 282238499, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915}
2025-03-03 00:37:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18216915&page=1>
{'review': 'very nice❤️', 'review_id': 282238499, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915}
2025-03-03 00:37:52 [reviews] INFO: Scraped item: {'review': 'worst dum biryani', 'review_id': 281954418, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915}
2025-03-03 00:37:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18216915&page=1>
{'review': 'worst dum biryani', 'review_id': 281954418, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915}
2025-03-03 00:37:52 [reviews] INFO: Scraped item: {'review': 'good taste ', 'review_id': 281925333, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915}
2025-03-03 00:37:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18216915&page=1>
{'review': 'good taste ', 'review_id': 281925333, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915}
2025-03-03 00:37:52 [reviews] INFO: Scraped item: {'review': 'it was a shit', 'review_id': 281684926, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915}
2025-03-03 00:37:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18216915&page=1>
{'review': 'it was a shit', 'review_id': 281684926, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915}
2025-03-03 00:37:52 [reviews] INFO: Scraped item: {'review': 'rice not good flavour not good', 'review_id': 281573845, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915}
2025-03-03 00:37:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18216915&page=1>
{'review': 'rice not good flavour not good', 'review_id': 281573845, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915}
2025-03-03 00:37:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=46672&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:37:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18257196&page=1> (referer: None)
2025-03-03 00:37:58 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Kandivali East', 'platform': 'zomato', 'res_id': 18257196, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962222, 'download_latency': 0.9817888736724854, 'depth': 0}
2025-03-03 00:37:58 [reviews] ERROR: Unrecognized relative_date format: may 27, 2021
2025-03-03 00:37:58 [reviews] INFO: Stopping for res_id: 18257196 due to unrecognized date format: May 27, 2021.
2025-03-03 00:38:01 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=48323&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:38:03 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47171&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:38:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2025-03-03 00:38:06 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108
2025-03-03 00:38:06 [scrapy.extensions.logstats] INFO: Crawled 42 pages (at 8 pages/min), scraped 132 items (at 26 items/min)
2025-03-03 00:38:07 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=40083&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:38:11 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=41143&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:38:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47458&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18324118&page=1> (referer: None)
2025-03-03 00:38:20 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962243, 'download_latency': 0.7301781177520752, 'depth': 0}
2025-03-03 00:38:20 [reviews] INFO: Scraped item: {'review': 'the quantity could be a little better , but the taste was amazing ', 'review_id': 281831586, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118}
2025-03-03 00:38:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18324118&page=1>
{'review': 'the quantity could be a little better , but the taste was amazing ', 'review_id': 281831586, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118}
2025-03-03 00:38:20 [reviews] INFO: Scraped item: {'review': 'Its very tasty but the quantity is less ', 'review_id': 281574030, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118}
2025-03-03 00:38:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18324118&page=1>
{'review': 'Its very tasty but the quantity is less ', 'review_id': 281574030, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118}
2025-03-03 00:38:20 [reviews] INFO: Scraped item: {'review': 'chicken wonton soup is quite plain n comes with 4 wonton dumplings.. the cover of that dumpling tastes quiteee plainn n bad tbh.. theres nothing in soup just 4 dumplings..<br/><br/>chicken clear soup is quite basic n simple.. not great nor bad.. ok ok..', 'review_id': 281528542, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118}
2025-03-03 00:38:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18324118&page=1>
{'review': 'chicken wonton soup is quite plain n comes with 4 wonton dumplings.. the cover of that dumpling tastes quiteee plainn n bad tbh.. theres nothing in soup just 4 dumplings..<br/><br/>chicken clear soup is quite basic n simple.. not great nor bad.. ok ok..', 'review_id': 281528542, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118}
2025-03-03 00:38:20 [reviews] INFO: Scraped item: {'review': 'Very bad chicken tikka gravy !! Very just 4 tiny pieces of chicken and very spicy ! Very bad', 'review_id': 281475736, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118}
2025-03-03 00:38:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18324118&page=1>
{'review': 'Very bad chicken tikka gravy !! Very just 4 tiny pieces of chicken and very spicy ! Very bad', 'review_id': 281475736, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118}
2025-03-03 00:38:20 [reviews] INFO: Scraped item: {'review': "My chapati didn't come in the package only", 'review_id': 281462468, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118}
2025-03-03 00:38:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18324118&page=1>
{'review': "My chapati didn't come in the package only", 'review_id': 281462468, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118}
2025-03-03 00:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18326064&page=1> (referer: None)
2025-03-03 00:38:23 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Phoenix Marketcity (Kurla)', 'platform': 'zomato', 'res_id': 18326064, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962249, 'download_latency': 0.7107353210449219, 'depth': 0}
2025-03-03 00:38:23 [reviews] INFO: Stopping for res_id: 18326064 as reviews are older than 7 days.
2025-03-03 00:38:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=49608&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:38:30 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=306805&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:38:34 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=312995&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:38:37 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=43965&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:38:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18349461&page=1> (referer: None)
2025-03-03 00:38:42 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962264, 'download_latency': 0.6941547393798828, 'depth': 0}
2025-03-03 00:38:42 [reviews] INFO: Scraped item: {'review': 'The order was delayed by 1 hour...when raised the concern ..was told to report once order is delivered...I will get compensation...but not able to report in chat', 'review_id': 282220435, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461}
2025-03-03 00:38:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18349461&page=1>
{'review': 'The order was delayed by 1 hour...when raised the concern ..was told to report once order is delivered...I will get compensation...but not able to report in chat', 'review_id': 282220435, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461}
2025-03-03 00:38:42 [reviews] INFO: Scraped item: {'review': 'great food. only quantity is little low and a bit high on oil!! <br/>taste amazing', 'review_id': 281673895, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461}
2025-03-03 00:38:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18349461&page=1>
{'review': 'great food. only quantity is little low and a bit high on oil!! <br/>taste amazing', 'review_id': 281673895, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461}
2025-03-03 00:38:42 [reviews] INFO: Scraped item: {'review': 'Full katvha n sukha hai', 'review_id': 280960765, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461}
2025-03-03 00:38:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18349461&page=1>
{'review': 'Full katvha n sukha hai', 'review_id': 280960765, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461}
2025-03-03 00:38:42 [reviews] INFO: Stopping for res_id: 18349461 as reviews are older than 7 days.
2025-03-03 00:38:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18350121&page=1> (referer: None)
2025-03-03 00:38:46 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18350121, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962269, 'download_latency': 0.7687046527862549, 'depth': 0}
2025-03-03 00:38:46 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281247480, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18350121}
2025-03-03 00:38:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18350121&page=1>
{'review': '', 'review_id': 281247480, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18350121}
2025-03-03 00:38:46 [reviews] INFO: Scraped item: {'review': 'The way you gays send the order was outstanding cold drink was wrapped with aluminium foil just to keep it cool for longer time. Totally appreciate the efforts which you guys made. Kudos ', 'review_id': 281209886, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18350121}
2025-03-03 00:38:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18350121&page=1>
{'review': 'The way you gays send the order was outstanding cold drink was wrapped with aluminium foil just to keep it cool for longer time. Totally appreciate the efforts which you guys made. Kudos ', 'review_id': 281209886, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18350121}
2025-03-03 00:38:46 [reviews] INFO: Scraped item: {'review': 'worth it 👌🏻 ', 'review_id': 280864451, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18350121}
2025-03-03 00:38:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18350121&page=1>
{'review': 'worth it 👌🏻 ', 'review_id': 280864451, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18350121}
2025-03-03 00:38:46 [reviews] INFO: Stopping for res_id: 18350121 as reviews are older than 7 days.
2025-03-03 00:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18363082&page=1> (referer: None)
2025-03-03 00:38:50 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962273, 'download_latency': 0.7507610321044922, 'depth': 0}
2025-03-03 00:38:50 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281628238, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082}
2025-03-03 00:38:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18363082&page=1>
{'review': '', 'review_id': 281628238, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082}
2025-03-03 00:38:50 [reviews] INFO: Scraped item: {'review': 'The quantity is very less considering the high price.', 'review_id': 281614911, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082}
2025-03-03 00:38:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18363082&page=1>
{'review': 'The quantity is very less considering the high price.', 'review_id': 281614911, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082}
2025-03-03 00:38:50 [reviews] INFO: Scraped item: {'review': 'naan was too hard to chew', 'review_id': 281313894, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082}
2025-03-03 00:38:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18363082&page=1>
{'review': 'naan was too hard to chew', 'review_id': 281313894, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082}
2025-03-03 00:38:50 [reviews] INFO: Scraped item: {'review': 'Chicken was not fresh. Was smelling. Money waste', 'review_id': 281147981, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082}
2025-03-03 00:38:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18363082&page=1>
{'review': 'Chicken was not fresh. Was smelling. Money waste', 'review_id': 281147981, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082}
2025-03-03 00:38:50 [reviews] INFO: Scraped item: {'review': 'Smoky flavour of that Typical good quality Biryani was missing', 'review_id': 280462112, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082}
2025-03-03 00:38:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18363082&page=1>
{'review': 'Smoky flavour of that Typical good quality Biryani was missing', 'review_id': 280462112, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082}
2025-03-03 00:38:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18216915&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:38:57 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=46672&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:39:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=48323&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:39:04 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47171&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2025-03-03 00:39:06 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108
2025-03-03 00:39:06 [scrapy.extensions.logstats] INFO: Crawled 47 pages (at 5 pages/min), scraped 148 items (at 16 items/min)
2025-03-03 00:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365184&page=1> (referer: None)
2025-03-03 00:39:07 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962288, 'download_latency': 0.6840593814849854, 'depth': 0}
2025-03-03 00:39:07 [reviews] INFO: Scraped item: {'review': 'Nice location.', 'review_id': 282180601, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184}
2025-03-03 00:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365184&page=1>
{'review': 'Nice location.', 'review_id': 282180601, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184}
2025-03-03 00:39:07 [reviews] INFO: Scraped item: {'review': 'nice', 'review_id': 282157660, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184}
2025-03-03 00:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365184&page=1>
{'review': 'nice', 'review_id': 282157660, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184}
2025-03-03 00:39:07 [reviews] INFO: Scraped item: {'review': 'The food and the hospitality was very good. we had a great time. <br/>', 'review_id': 281989733, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184}
2025-03-03 00:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365184&page=1>
{'review': 'The food and the hospitality was very good. we had a great time. <br/>', 'review_id': 281989733, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184}
2025-03-03 00:39:07 [reviews] INFO: Scraped item: {'review': 'Nice service and delicious food.', 'review_id': 281772980, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184}
2025-03-03 00:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365184&page=1>
{'review': 'Nice service and delicious food.', 'review_id': 281772980, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184}
2025-03-03 00:39:07 [reviews] INFO: Scraped item: {'review': 'Was given a Maharaja sizzler for trial and the taste was exquisite and the Indian fusion was very well executed .', 'review_id': 281764383, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184}
2025-03-03 00:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365184&page=1>
{'review': 'Was given a Maharaja sizzler for trial and the taste was exquisite and the Indian fusion was very well executed .', 'review_id': 281764383, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184}
2025-03-03 00:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365355&page=1> (referer: None)
2025-03-03 00:39:10 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18365355, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962292, 'download_latency': 0.6846828460693359, 'depth': 0}
2025-03-03 00:39:10 [reviews] INFO: Scraped item: {'review': 'This was meant for kids , the chicken was raw , with whatever I could collect', 'review_id': 281962364, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18365355}
2025-03-03 00:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365355&page=1>
{'review': 'This was meant for kids , the chicken was raw , with whatever I could collect', 'review_id': 281962364, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18365355}
2025-03-03 00:39:10 [reviews] INFO: Scraped item: {'review': 'Worst packaging and taste also pathetic', 'review_id': 281811433, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18365355}
2025-03-03 00:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365355&page=1>
{'review': 'Worst packaging and taste also pathetic', 'review_id': 281811433, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18365355}
2025-03-03 00:39:10 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281591915, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18365355}
2025-03-03 00:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365355&page=1>
{'review': '', 'review_id': 281591915, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18365355}
2025-03-03 00:39:10 [reviews] INFO: Scraped item: {'review': 'they delayed my order, and food quality was also not good. very spicy even after choosing mild spicy option ', 'review_id': 280709264, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18365355}
2025-03-03 00:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365355&page=1>
{'review': 'they delayed my order, and food quality was also not good. very spicy even after choosing mild spicy option ', 'review_id': 280709264, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18365355}
2025-03-03 00:39:10 [reviews] INFO: Scraped item: {'review': 'There is no salt and too much masala. Further the worst thing is there is hair in Gulab Jamun.<br/>', 'review_id': 280510225, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18365355}
2025-03-03 00:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365355&page=1>
{'review': 'There is no salt and too much masala. Further the worst thing is there is hair in Gulab Jamun.<br/>', 'review_id': 280510225, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18365355}
2025-03-03 00:39:14 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47458&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365868&page=1> (referer: None)
2025-03-03 00:39:18 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962300, 'download_latency': 0.7627677917480469, 'depth': 0}
2025-03-03 00:39:18 [reviews] INFO: Scraped item: {'review': 'not so good ', 'review_id': 282095817, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868}
2025-03-03 00:39:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365868&page=1>
{'review': 'not so good ', 'review_id': 282095817, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868}
2025-03-03 00:39:18 [reviews] INFO: Scraped item: {'review': 'how biryani can be sweet. refund my money ', 'review_id': 281828486, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868}
2025-03-03 00:39:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365868&page=1>
{'review': 'how biryani can be sweet. refund my money ', 'review_id': 281828486, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868}
2025-03-03 00:39:18 [reviews] INFO: Stopping for res_id: 18365868 as reviews are older than 7 days.
2025-03-03 00:39:21 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18324118&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:39:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=49608&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:39:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=306805&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:39:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=312995&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365882&page=1> (referer: None)
2025-03-03 00:39:37 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962318, 'download_latency': 1.5792627334594727, 'depth': 0}
2025-03-03 00:39:37 [reviews] INFO: Scraped item: {'review': 'good', 'review_id': 282024087, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882}
2025-03-03 00:39:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365882&page=1>
{'review': 'good', 'review_id': 282024087, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882}
2025-03-03 00:39:37 [reviews] INFO: Scraped item: {'review': 'taste all good....but low quantity ', 'review_id': 281744628, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882}
2025-03-03 00:39:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365882&page=1>
{'review': 'taste all good....but low quantity ', 'review_id': 281744628, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882}
2025-03-03 00:39:37 [reviews] INFO: Scraped item: {'review': 'Quantity is less', 'review_id': 281636020, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882}
2025-03-03 00:39:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365882&page=1>
{'review': 'Quantity is less', 'review_id': 281636020, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882}
2025-03-03 00:39:37 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281370180, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882}
2025-03-03 00:39:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365882&page=1>
{'review': '', 'review_id': 281370180, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882}
2025-03-03 00:39:37 [reviews] INFO: Scraped item: {'review': 'ontime delivery ', 'review_id': 281364184, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882}
2025-03-03 00:39:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365882&page=1>
{'review': 'ontime delivery ', 'review_id': 281364184, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882}
2025-03-03 00:39:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365897&page=1> (referer: None)
2025-03-03 00:39:41 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962323, 'download_latency': 0.7023255825042725, 'depth': 0}
2025-03-03 00:39:41 [reviews] INFO: Scraped item: {'review': 'Haleem his not good tasteless haleem my mom Haleem review  very bad not god test ', 'review_id': 282092203, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897}
2025-03-03 00:39:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365897&page=1>
{'review': 'Haleem his not good tasteless haleem my mom Haleem review  very bad not god test ', 'review_id': 282092203, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897}
2025-03-03 00:39:41 [reviews] INFO: Scraped item: {'review': 'its too garam masala on biryani tasteless experience. <br/>maine pehle bhi khai h but bhut acha hota tha taste isme bhut jada garam masala h bilkul nhi khai jaa rhi', 'review_id': 281145595, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897}
2025-03-03 00:39:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365897&page=1>
{'review': 'its too garam masala on biryani tasteless experience. <br/>maine pehle bhi khai h but bhut acha hota tha taste isme bhut jada garam masala h bilkul nhi khai jaa rhi', 'review_id': 281145595, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897}
2025-03-03 00:39:41 [reviews] INFO: Stopping for res_id: 18365897 as reviews are older than 7 days.
2025-03-03 00:39:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365991&page=1> (referer: None)
2025-03-03 00:39:43 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18365991, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962327, 'download_latency': 0.7189481258392334, 'depth': 0}
2025-03-03 00:39:43 [reviews] INFO: Scraped item: {'review': 'food is not properly baked as it was a waste of money for me at this time ', 'review_id': 281498001, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18365991}
2025-03-03 00:39:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365991&page=1>
{'review': 'food is not properly baked as it was a waste of money for me at this time ', 'review_id': 281498001, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18365991}
2025-03-03 00:39:43 [reviews] INFO: Scraped item: {'review': '', 'review_id': 280832964, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18365991}
2025-03-03 00:39:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365991&page=1>
{'review': '', 'review_id': 280832964, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18365991}
2025-03-03 00:39:43 [reviews] INFO: Stopping for res_id: 18365991 as reviews are older than 7 days.
2025-03-03 00:39:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18368221&page=1> (referer: None)
2025-03-03 00:39:47 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18368221, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962330, 'download_latency': 0.6847691535949707, 'depth': 0}
2025-03-03 00:39:47 [reviews] INFO: Scraped item: {'review': 'Gosht Haleema is delicious and rich.<br/>Dilkhush Naram Kulchas are soft and yummy. perfect combination. ', 'review_id': 282190015, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18368221}
2025-03-03 00:39:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18368221&page=1>
{'review': 'Gosht Haleema is delicious and rich.<br/>Dilkhush Naram Kulchas are soft and yummy. perfect combination. ', 'review_id': 282190015, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18368221}
2025-03-03 00:39:47 [reviews] INFO: Scraped item: {'review': 'Very worst in taste better not to order hallem here', 'review_id': 281677571, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18368221}
2025-03-03 00:39:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18368221&page=1>
{'review': 'Very worst in taste better not to order hallem here', 'review_id': 281677571, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18368221}
2025-03-03 00:39:47 [reviews] INFO: Stopping for res_id: 18368221 as reviews are older than 7 days.
2025-03-03 00:39:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18363082&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:39:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18216915&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:39:58 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=48323&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:40:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372009&page=1> (referer: None)
2025-03-03 00:40:02 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962345, 'download_latency': 0.9494471549987793, 'depth': 0}
2025-03-03 00:40:02 [reviews] INFO: Scraped item: {'review': 'Briyani had little weird taste and the vegetables skin are spread across the food', 'review_id': 281996831, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009}
2025-03-03 00:40:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372009&page=1>
{'review': 'Briyani had little weird taste and the vegetables skin are spread across the food', 'review_id': 281996831, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009}
2025-03-03 00:40:02 [reviews] INFO: Scraped item: {'review': 'delayed order ', 'review_id': 281613892, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009}
2025-03-03 00:40:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372009&page=1>
{'review': 'delayed order ', 'review_id': 281613892, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009}
2025-03-03 00:40:02 [reviews] INFO: Scraped item: {'review': 'Delay from the restaurant. Order which was expected to reach within 40 mins took more than a hour for delivery. Delivery partner also got to suffer loss due to delay. Behrouz need to really need to improve on their delivery timing.', 'review_id': 281605935, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009}
2025-03-03 00:40:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372009&page=1>
{'review': 'Delay from the restaurant. Order which was expected to reach within 40 mins took more than a hour for delivery. Delivery partner also got to suffer loss due to delay. Behrouz need to really need to improve on their delivery timing.', 'review_id': 281605935, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009}
2025-03-03 00:40:02 [reviews] INFO: Scraped item: {'review': 'Blant taste .. less quantity', 'review_id': 281447816, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009}
2025-03-03 00:40:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372009&page=1>
{'review': 'Blant taste .. less quantity', 'review_id': 281447816, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009}
2025-03-03 00:40:02 [reviews] INFO: Scraped item: {'review': 'The food was good, but the preparation took too long. which delayed the delivery quite a bit.', 'review_id': 281288735, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009}
2025-03-03 00:40:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372009&page=1>
{'review': 'The food was good, but the preparation took too long. which delayed the delivery quite a bit.', 'review_id': 281288735, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009}
2025-03-03 00:40:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2025-03-03 00:40:06 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108
2025-03-03 00:40:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372044&page=1> (referer: None)
2025-03-03 00:40:06 [scrapy.extensions.logstats] INFO: Crawled 56 pages (at 9 pages/min), scraped 176 items (at 28 items/min)
2025-03-03 00:40:06 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962348, 'download_latency': 1.2941772937774658, 'depth': 0}
2025-03-03 00:40:06 [reviews] INFO: Scraped item: {'review': 'Veg biryani was bad just had pepper no other masala', 'review_id': 280875887, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044}
2025-03-03 00:40:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372044&page=1>
{'review': 'Veg biryani was bad just had pepper no other masala', 'review_id': 280875887, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044}
2025-03-03 00:40:06 [reviews] INFO: Stopping for res_id: 18372044 as reviews are older than 7 days.
2025-03-03 00:40:10 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365184&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:40:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365355&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:40:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18381663&page=1> (referer: None)
2025-03-03 00:40:17 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962358, 'download_latency': 0.704780101776123, 'depth': 0}
2025-03-03 00:40:17 [reviews] INFO: Scraped item: {'review': '', 'review_id': 282007880, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663}
2025-03-03 00:40:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18381663&page=1>
{'review': '', 'review_id': 282007880, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663}
2025-03-03 00:40:17 [reviews] INFO: Scraped item: {'review': 'awesome preparation @ Sajid khan, Nehru Palace, New Delhi ', 'review_id': 281748820, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663}
2025-03-03 00:40:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18381663&page=1>
{'review': 'awesome preparation @ Sajid khan, Nehru Palace, New Delhi ', 'review_id': 281748820, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663}
2025-03-03 00:40:17 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281360490, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663}
2025-03-03 00:40:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18381663&page=1>
{'review': '', 'review_id': 281360490, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663}
2025-03-03 00:40:17 [reviews] INFO: Stopping for res_id: 18381663 as reviews are older than 7 days.
2025-03-03 00:40:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18324118&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:40:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=49608&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:40:26 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=306805&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:40:29 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=312995&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:40:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18382342&page=1> (referer: None)
2025-03-03 00:40:34 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 56, 'brand_name': 'Noshi - Yum Asian Delivery', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18382342, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962378, 'download_latency': 0.6785471439361572, 'depth': 0}
2025-03-03 00:40:34 [reviews] INFO: Scraped item: {'review': 'The sushi is so over filled today - tastes horrible', 'review_id': 281061335, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 56, 'brand_name': 'Noshi - Yum Asian Delivery', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18382342}
2025-03-03 00:40:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18382342&page=1>
{'review': 'The sushi is so over filled today - tastes horrible', 'review_id': 281061335, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 56, 'brand_name': 'Noshi - Yum Asian Delivery', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18382342}
2025-03-03 00:40:34 [reviews] INFO: Scraped item: {'review': 'I am a regular (once 2weeks) at noshi but quite disappointed to see that this is the first time they have blundered my order. <br/>1. 2/3 sushi in triple box were something I never ordered <br/>2. the over quality of sushi was quite bad that I had to throw almost 80% of it <br/>3. the sweetness and taginess of dimsums were not balanced at all <br/><br/>overall ny first bad experience  with noshi I hope you do better 🙏', 'review_id': 280814633, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 56, 'brand_name': 'Noshi - Yum Asian Delivery', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18382342}
2025-03-03 00:40:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18382342&page=1>
{'review': 'I am a regular (once 2weeks) at noshi but quite disappointed to see that this is the first time they have blundered my order. <br/>1. 2/3 sushi in triple box were something I never ordered <br/>2. the over quality of sushi was quite bad that I had to throw almost 80% of it <br/>3. the sweetness and taginess of dimsums were not balanced at all <br/><br/>overall ny first bad experience  with noshi I hope you do better 🙏', 'review_id': 280814633, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 56, 'brand_name': 'Noshi - Yum Asian Delivery', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18382342}
2025-03-03 00:40:34 [reviews] INFO: Scraped item: {'review': '', 'review_id': 280253100, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 56, 'brand_name': 'Noshi - Yum Asian Delivery', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18382342}
2025-03-03 00:40:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18382342&page=1>
{'review': '', 'review_id': 280253100, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 56, 'brand_name': 'Noshi - Yum Asian Delivery', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18382342}
2025-03-03 00:40:34 [reviews] INFO: Scraped item: {'review': '', 'review_id': 280252947, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 56, 'brand_name': 'Noshi - Yum Asian Delivery', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18382342}
2025-03-03 00:40:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18382342&page=1>
{'review': '', 'review_id': 280252947, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 56, 'brand_name': 'Noshi - Yum Asian Delivery', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18382342}
2025-03-03 00:40:34 [reviews] INFO: Stopping for res_id: 18382342 as reviews are older than 7 days.
2025-03-03 00:40:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365882&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:40:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18440182&page=1> (referer: None)
2025-03-03 00:40:39 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962384, 'download_latency': 0.6703717708587646, 'depth': 0}
2025-03-03 00:40:39 [reviews] INFO: Scraped item: {'review': 'much less chicken than usual, disappointing.', 'review_id': 282122252, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182}
2025-03-03 00:40:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18440182&page=1>
{'review': 'much less chicken than usual, disappointing.', 'review_id': 282122252, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182}
2025-03-03 00:40:39 [reviews] INFO: Scraped item: {'review': 'too much salt', 'review_id': 281989738, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182}
2025-03-03 00:40:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18440182&page=1>
{'review': 'too much salt', 'review_id': 281989738, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182}
2025-03-03 00:40:39 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281541020, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182}
2025-03-03 00:40:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18440182&page=1>
{'review': '', 'review_id': 281541020, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182}
2025-03-03 00:40:39 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281468902, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182}
2025-03-03 00:40:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18440182&page=1>
{'review': '', 'review_id': 281468902, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182}
2025-03-03 00:40:39 [reviews] INFO: Scraped item: {'review': 'Very very spicy..not able to eat', 'review_id': 281444416, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182}
2025-03-03 00:40:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18440182&page=1>
{'review': 'Very very spicy..not able to eat', 'review_id': 281444416, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182}
2025-03-03 00:40:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18466435&page=1> (referer: None)
2025-03-03 00:40:44 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962387, 'download_latency': 0.669358491897583, 'depth': 0}
2025-03-03 00:40:44 [reviews] INFO: Scraped item: {'review': 'Excellent', 'review_id': 282191836, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435}
2025-03-03 00:40:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18466435&page=1>
{'review': 'Excellent', 'review_id': 282191836, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435}
2025-03-03 00:40:44 [reviews] INFO: Scraped item: {'review': "not worth the amount spend.. just luring people by good posters pics. don't order from here , not worth atall. ", 'review_id': 282135798, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435}
2025-03-03 00:40:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18466435&page=1>
{'review': "not worth the amount spend.. just luring people by good posters pics. don't order from here , not worth atall. ", 'review_id': 282135798, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435}
2025-03-03 00:40:44 [reviews] INFO: Scraped item: {'review': 'put some more chicken', 'review_id': 282030698, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435}
2025-03-03 00:40:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18466435&page=1>
{'review': 'put some more chicken', 'review_id': 282030698, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435}
2025-03-03 00:40:44 [reviews] INFO: Scraped item: {'review': 'Biryani was horrible. The rice were half cooked. No taste. No masala. Money wastage.  Pls dont order from this restaurant - mood off in front of guest.', 'review_id': 281793120, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435}
2025-03-03 00:40:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18466435&page=1>
{'review': 'Biryani was horrible. The rice were half cooked. No taste. No masala. Money wastage.  Pls dont order from this restaurant - mood off in front of guest.', 'review_id': 281793120, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435}
2025-03-03 00:40:44 [reviews] INFO: Scraped item: {'review': 'The biryanis were really dry and flavourless. We ordered because we had guests over .. about 10 people and it was very disappointing as the biryani tasted so bad', 'review_id': 281729751, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435}
2025-03-03 00:40:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18466435&page=1>
{'review': 'The biryanis were really dry and flavourless. We ordered because we had guests over .. about 10 people and it was very disappointing as the biryani tasted so bad', 'review_id': 281729751, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435}
2025-03-03 00:40:47 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18363082&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:40:51 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18216915&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:40:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18535370&page=1> (referer: None)
2025-03-03 00:40:55 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962398, 'download_latency': 0.7566449642181396, 'depth': 0}
2025-03-03 00:40:55 [reviews] INFO: Scraped item: {'review': 'Biriyani was too tasty and packaging is also good ', 'review_id': 281812029, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370}
2025-03-03 00:40:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18535370&page=1>
{'review': 'Biriyani was too tasty and packaging is also good ', 'review_id': 281812029, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370}
2025-03-03 00:40:55 [reviews] INFO: Scraped item: {'review': 'Spices and Salt are imbalanced\U0001f979', 'review_id': 281751828, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370}
2025-03-03 00:40:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18535370&page=1>
{'review': 'Spices and Salt are imbalanced\U0001f979', 'review_id': 281751828, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370}
2025-03-03 00:40:55 [reviews] INFO: Scraped item: {'review': 'sorry 😞 ', 'review_id': 281564900, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370}
2025-03-03 00:40:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18535370&page=1>
{'review': 'sorry 😞 ', 'review_id': 281564900, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370}
2025-03-03 00:40:55 [reviews] INFO: Scraped item: {'review': 'Biryani was like pulao not biryani....tasteless', 'review_id': 281506286, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370}
2025-03-03 00:40:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18535370&page=1>
{'review': 'Biryani was like pulao not biryani....tasteless', 'review_id': 281506286, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370}
2025-03-03 00:40:55 [reviews] INFO: Scraped item: {'review': 'Awesome', 'review_id': 281447062, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370}
2025-03-03 00:40:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18535370&page=1>
{'review': 'Awesome', 'review_id': 281447062, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370}
2025-03-03 00:41:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18537577&page=1> (referer: None)
2025-03-03 00:41:00 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 55, 'brand_name': 'Enoki - Fresh Asian Kitchen', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18537577, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962403, 'download_latency': 0.7344334125518799, 'depth': 0}
2025-03-03 00:41:00 [reviews] INFO: Scraped item: {'review': '', 'review_id': 282203908, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 55, 'brand_name': 'Enoki - Fresh Asian Kitchen', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18537577}
2025-03-03 00:41:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18537577&page=1>
{'review': '', 'review_id': 282203908, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 55, 'brand_name': 'Enoki - Fresh Asian Kitchen', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18537577}
2025-03-03 00:41:00 [reviews] INFO: Scraped item: {'review': 'Dragon rolls arrived burnt', 'review_id': 280752054, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 55, 'brand_name': 'Enoki - Fresh Asian Kitchen', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18537577}
2025-03-03 00:41:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18537577&page=1>
{'review': 'Dragon rolls arrived burnt', 'review_id': 280752054, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 55, 'brand_name': 'Enoki - Fresh Asian Kitchen', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18537577}
2025-03-03 00:41:00 [reviews] INFO: Scraped item: {'review': '', 'review_id': 280630228, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 55, 'brand_name': 'Enoki - Fresh Asian Kitchen', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18537577}
2025-03-03 00:41:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18537577&page=1>
{'review': '', 'review_id': 280630228, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 55, 'brand_name': 'Enoki - Fresh Asian Kitchen', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18537577}
2025-03-03 00:41:00 [reviews] INFO: Scraped item: {'review': '', 'review_id': 280465152, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 55, 'brand_name': 'Enoki - Fresh Asian Kitchen', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18537577}
2025-03-03 00:41:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18537577&page=1>
{'review': '', 'review_id': 280465152, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 55, 'brand_name': 'Enoki - Fresh Asian Kitchen', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18537577}
2025-03-03 00:41:00 [reviews] INFO: Stopping for res_id: 18537577 as reviews are older than 7 days.
2025-03-03 00:41:03 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372009&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:41:06 [scrapy.extensions.logstats] INFO: Crawled 62 pages (at 6 pages/min), scraped 203 items (at 27 items/min)
2025-03-03 00:41:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365184&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:41:11 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365355&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:41:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18544058&page=1> (referer: None)
2025-03-03 00:41:15 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 53, 'brand_name': 'Yum Yum Cha', 'city': 'New Delhi', 'sub_zone': 'Khan Market', 'platform': 'zomato', 'res_id': 18544058, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962418, 'download_latency': 0.6927812099456787, 'depth': 0}
2025-03-03 00:41:15 [reviews] INFO: Scraped item: {'review': 'We recently visited Yum Yum Cha, a place often hyped for its food and ambiance. Unfortunately, our experience was far from great.<br/><br/>The menu was undoubtedly extensive, offering a wide range of options. However, the service left much to be desired. We ordered a classic—Chicken Cheung Fun and Watermelon Mint Bottles. After waiting for 20 minutes, we had to remind them about our drinks, which should have been served much earlier.<br/><br/>What was even more frustrating was the long wait for our food. It took a full 45 minutes to arrive—something that usually takes no more than 15 minutes to prepare. To make matters worse, we noticed that the same dish was being served at other tables that had arrived after us.<br/><br/>With such delays and lack of attention, the service charge felt completely unjustified. Good food alone doesn’t make a great dining experience—timely service and customer care matter just as much.', 'review_id': 281459465, 'rating': '2', 'review_type': 'DINING', 'review_date': '2025-03-01', 'competitor_id': 53, 'brand_name': 'Yum Yum Cha', 'city': 'New Delhi', 'sub_zone': 'Khan Market', 'platform': 'zomato', 'res_id': 18544058}
2025-03-03 00:41:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18544058&page=1>
{'review': 'We recently visited Yum Yum Cha, a place often hyped for its food and ambiance. Unfortunately, our experience was far from great.<br/><br/>The menu was undoubtedly extensive, offering a wide range of options. However, the service left much to be desired. We ordered a classic—Chicken Cheung Fun and Watermelon Mint Bottles. After waiting for 20 minutes, we had to remind them about our drinks, which should have been served much earlier.<br/><br/>What was even more frustrating was the long wait for our food. It took a full 45 minutes to arrive—something that usually takes no more than 15 minutes to prepare. To make matters worse, we noticed that the same dish was being served at other tables that had arrived after us.<br/><br/>With such delays and lack of attention, the service charge felt completely unjustified. Good food alone doesn’t make a great dining experience—timely service and customer care matter just as much.', 'review_id': 281459465, 'rating': '2', 'review_type': 'DINING', 'review_date': '2025-03-01', 'competitor_id': 53, 'brand_name': 'Yum Yum Cha', 'city': 'New Delhi', 'sub_zone': 'Khan Market', 'platform': 'zomato', 'res_id': 18544058}
2025-03-03 00:41:15 [reviews] INFO: Stopping for res_id: 18544058 as reviews are older than 7 days.
2025-03-03 00:41:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18324118&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:41:23 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=49608&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:41:26 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=306805&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:41:30 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=312995&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:41:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18547628&page=1> (referer: None)
2025-03-03 00:41:35 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962434, 'download_latency': 0.6474254131317139, 'depth': 0}
2025-03-03 00:41:35 [reviews] INFO: Scraped item: {'review': "very spicy & solt, it's not dum biriyani ok, just joking ", 'review_id': 281841479, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628}
2025-03-03 00:41:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18547628&page=1>
{'review': "very spicy & solt, it's not dum biriyani ok, just joking ", 'review_id': 281841479, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628}
2025-03-03 00:41:35 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281677959, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628}
2025-03-03 00:41:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18547628&page=1>
{'review': '', 'review_id': 281677959, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628}
2025-03-03 00:41:35 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281342353, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628}
2025-03-03 00:41:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18547628&page=1>
{'review': '', 'review_id': 281342353, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628}
2025-03-03 00:41:35 [reviews] INFO: Scraped item: {'review': 'all things right but I felt a little bit salty in taste.', 'review_id': 281125854, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628}
2025-03-03 00:41:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18547628&page=1>
{'review': 'all things right but I felt a little bit salty in taste.', 'review_id': 281125854, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628}
2025-03-03 00:41:35 [reviews] INFO: Scraped item: {'review': 'Took a lot of time', 'review_id': 280511588, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628}
2025-03-03 00:41:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18547628&page=1>
{'review': 'Took a lot of time', 'review_id': 280511588, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628}
2025-03-03 00:41:38 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365882&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:41:45 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18440182&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:41:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18575415&page=1> (referer: None)
2025-03-03 00:41:46 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962440, 'download_latency': 4.963107109069824, 'depth': 0}
2025-03-03 00:41:46 [reviews] INFO: Scraped item: {'review': 'Delicious', 'review_id': 281703254, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415}
2025-03-03 00:41:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18575415&page=1>
{'review': 'Delicious', 'review_id': 281703254, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415}
2025-03-03 00:41:46 [reviews] INFO: Scraped item: {'review': 'Vietnamese Pho has been excellent during these winters. Ordered twice and was not disappointed. tangy, filling in a sizeable portion.  ', 'review_id': 281623990, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415}
2025-03-03 00:41:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18575415&page=1>
{'review': 'Vietnamese Pho has been excellent during these winters. Ordered twice and was not disappointed. tangy, filling in a sizeable portion.  ', 'review_id': 281623990, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415}
2025-03-03 00:41:46 [reviews] INFO: Scraped item: {'review': 'The food was great and shyam made sure we enjoyed our meal ! Great service !', 'review_id': 281383254, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-01', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415}
2025-03-03 00:41:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18575415&page=1>
{'review': 'The food was great and shyam made sure we enjoyed our meal ! Great service !', 'review_id': 281383254, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-01', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415}
2025-03-03 00:41:46 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281073209, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415}
2025-03-03 00:41:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18575415&page=1>
{'review': '', 'review_id': 281073209, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415}
2025-03-03 00:41:46 [reviews] INFO: Scraped item: {'review': '', 'review_id': 280730194, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415}
2025-03-03 00:41:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18575415&page=1>
{'review': '', 'review_id': 280730194, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415}
2025-03-03 00:41:47 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18466435&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:41:51 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18363082&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:41:55 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18216915&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:41:59 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18535370&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:42:03 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372009&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:42:06 [scrapy.extensions.logstats] INFO: Crawled 65 pages (at 3 pages/min), scraped 214 items (at 11 items/min)
2025-03-03 00:42:08 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365184&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:42:12 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365355&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:42:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18577108&page=1> (referer: None)
2025-03-03 00:42:17 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962476, 'download_latency': 0.8599667549133301, 'depth': 0}
2025-03-03 00:42:17 [reviews] INFO: Scraped item: {'review': 'Food is very dried and the bowl is half the portion', 'review_id': 282182299, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108}
2025-03-03 00:42:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18577108&page=1>
{'review': 'Food is very dried and the bowl is half the portion', 'review_id': 282182299, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108}
2025-03-03 00:42:17 [reviews] INFO: Scraped item: {'review': 'Really great food and ambience. Amazing service by swapan as well', 'review_id': 281823669, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108}
2025-03-03 00:42:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18577108&page=1>
{'review': 'Really great food and ambience. Amazing service by swapan as well', 'review_id': 281823669, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108}
2025-03-03 00:42:17 [reviews] INFO: Scraped item: {'review': "I'd definitely recommend this place for food. we had miso ramen, pan fried chicken noodles and chicken thai green curry. The latter 2 were amazing, however the miso ramen wasn't authentic. I'd rather prefer Soy Yum for ramen.  <br/>Portion size is rather large so sharing is definitely recommended. overall a nice experience ", 'review_id': 281548575, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108}
2025-03-03 00:42:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18577108&page=1>
{'review': "I'd definitely recommend this place for food. we had miso ramen, pan fried chicken noodles and chicken thai green curry. The latter 2 were amazing, however the miso ramen wasn't authentic. I'd rather prefer Soy Yum for ramen.  <br/>Portion size is rather large so sharing is definitely recommended. overall a nice experience ", 'review_id': 281548575, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108}
2025-03-03 00:42:17 [reviews] INFO: Scraped item: {'review': 'there was a sharp nail jutting out of my chait. it tore my pants. The japchae was really spicy but we checked the spicy sign was missing .', 'review_id': 281059971, 'rating': '2', 'review_type': 'DINING', 'review_date': '2025-02-28', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108}
2025-03-03 00:42:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18577108&page=1>
{'review': 'there was a sharp nail jutting out of my chait. it tore my pants. The japchae was really spicy but we checked the spicy sign was missing .', 'review_id': 281059971, 'rating': '2', 'review_type': 'DINING', 'review_date': '2025-02-28', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108}
2025-03-03 00:42:17 [reviews] INFO: Scraped item: {'review': 'The staff has no decency at all. They talk so casually and also told us to leave even though we had made the booking earlier.Very bad customer service. Would highly suggest to not visit this place.', 'review_id': 280401783, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-02-26', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108}
2025-03-03 00:42:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18577108&page=1>
{'review': 'The staff has no decency at all. They talk so casually and also told us to leave even though we had made the booking earlier.Very bad customer service. Would highly suggest to not visit this place.', 'review_id': 280401783, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-02-26', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108}
2025-03-03 00:42:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18324118&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:42:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=49608&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:42:26 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=306805&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:42:29 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=312995&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:42:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582428&page=1> (referer: None)
2025-03-03 00:42:34 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962495, 'download_latency': 1.8699421882629395, 'depth': 0}
2025-03-03 00:42:34 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281971975, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428}
2025-03-03 00:42:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582428&page=1>
{'review': '', 'review_id': 281971975, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428}
2025-03-03 00:42:34 [reviews] INFO: Scraped item: {'review': 'Very less portion of keema. not value for money.  Not fresh. ', 'review_id': 281562195, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428}
2025-03-03 00:42:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582428&page=1>
{'review': 'Very less portion of keema. not value for money.  Not fresh. ', 'review_id': 281562195, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428}
2025-03-03 00:42:34 [reviews] INFO: Scraped item: {'review': 'quantity jyada dedo bs baki all excelent', 'review_id': 281408090, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428}
2025-03-03 00:42:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582428&page=1>
{'review': 'quantity jyada dedo bs baki all excelent', 'review_id': 281408090, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428}
2025-03-03 00:42:34 [reviews] INFO: Scraped item: {'review': 'Awesome!', 'review_id': 281359295, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428}
2025-03-03 00:42:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582428&page=1>
{'review': 'Awesome!', 'review_id': 281359295, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428}
2025-03-03 00:42:34 [reviews] INFO: Scraped item: {'review': '', 'review_id': 280567462, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428}
2025-03-03 00:42:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582428&page=1>
{'review': '', 'review_id': 280567462, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428}
2025-03-03 00:42:37 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18547628&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:42:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18440182&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:42:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365882&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:42:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18575415&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:42:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18466435&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:42:53 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18363082&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:42:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18535370&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:43:01 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372009&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:43:05 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365184&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:43:06 [scrapy.extensions.logstats] INFO: Crawled 67 pages (at 2 pages/min), scraped 224 items (at 10 items/min)
2025-03-03 00:43:08 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365355&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:43:12 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18216915&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:43:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18577108&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:43:19 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18324118&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:43:22 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=306805&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:43:26 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=312995&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:43:31 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=49608&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:43:34 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582428&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:43:37 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18547628&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:43:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18440182&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:43:45 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18575415&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:43:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18466435&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:43:53 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365882&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:43:56 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18535370&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:43:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372009&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:44:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365184&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:44:05 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365355&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:44:06 [scrapy.extensions.logstats] INFO: Crawled 67 pages (at 0 pages/min), scraped 224 items (at 0 items/min)
2025-03-03 00:44:10 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18363082&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:44:13 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18577108&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:44:17 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18324118&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:44:20 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18216915&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:44:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582431&page=1> (referer: None)
2025-03-03 00:44:26 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962607, 'download_latency': 1.6860337257385254, 'depth': 0}
2025-03-03 00:44:26 [reviews] INFO: Scraped item: {'review': 'Had to give the food away as the instruction given for the order was not adhered with. Onion was sprinkled ON TOP OF BIRYANI AS GARNISHING!! Onion served in salad. Special request was to NOT USE ONION & CANCEL ORDER IF NOT POSSIBLE.', 'review_id': 282216521, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431}
2025-03-03 00:44:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582431&page=1>
{'review': 'Had to give the food away as the instruction given for the order was not adhered with. Onion was sprinkled ON TOP OF BIRYANI AS GARNISHING!! Onion served in salad. Special request was to NOT USE ONION & CANCEL ORDER IF NOT POSSIBLE.', 'review_id': 282216521, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431}
2025-03-03 00:44:26 [reviews] INFO: Scraped item: {'review': 'I specifically share food but not delivered. itni kanjoosi nahi dekhi abhi tak.', 'review_id': 281816875, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431}
2025-03-03 00:44:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582431&page=1>
{'review': 'I specifically share food but not delivered. itni kanjoosi nahi dekhi abhi tak.', 'review_id': 281816875, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431}
2025-03-03 00:44:26 [reviews] INFO: Scraped item: {'review': 'everything including the package quantity was Good, but too salty. overall biryani was good', 'review_id': 281472174, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431}
2025-03-03 00:44:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582431&page=1>
{'review': 'everything including the package quantity was Good, but too salty. overall biryani was good', 'review_id': 281472174, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431}
2025-03-03 00:44:26 [reviews] INFO: Scraped item: {'review': 'NOBODY READS INSTRUCTIONS....while placing order I made a mistake bcoz I was working n instead of chicken I pressed veg biryani option BUT IN INSTRUCTIONS..I mentioned pls make spicy & moist CHICKEN ....if I made a mistake so as zomato & BBK.<br/>nobody reverted why I have mentioned chicken when I I hv placed veg biryani....I Requested BBK ...KINDLY exchange the order will pay delivery charges   BUT they said if I would hv  placed directly then cud hv possible..but due to zomato they will not..STILL BBK got agreed that they will send BUT THEN ...PHONE OFF KAR DIYA...WHA', 'review_id': 281120609, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431}
2025-03-03 00:44:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582431&page=1>
{'review': 'NOBODY READS INSTRUCTIONS....while placing order I made a mistake bcoz I was working n instead of chicken I pressed veg biryani option BUT IN INSTRUCTIONS..I mentioned pls make spicy & moist CHICKEN ....if I made a mistake so as zomato & BBK.<br/>nobody reverted why I have mentioned chicken when I I hv placed veg biryani....I Requested BBK ...KINDLY exchange the order will pay delivery charges   BUT they said if I would hv  placed directly then cud hv possible..but due to zomato they will not..STILL BBK got agreed that they will send BUT THEN ...PHONE OFF KAR DIYA...WHA', 'review_id': 281120609, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431}
2025-03-03 00:44:26 [reviews] INFO: Scraped item: {'review': 'Salan or raita not provide in briyani', 'review_id': 280714669, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431}
2025-03-03 00:44:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582431&page=1>
{'review': 'Salan or raita not provide in briyani', 'review_id': 280714669, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431}
2025-03-03 00:44:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18628825&page=1> (referer: None)
2025-03-03 00:44:29 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 0, 'brand_name': 'La Veggie', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 18628825, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962611, 'download_latency': 0.8088183403015137, 'depth': 0}
2025-03-03 00:44:29 [reviews] INFO: Stopping for res_id: 18628825 as reviews are older than 7 days.
2025-03-03 00:44:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582428&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:44:34 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18547628&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:44:38 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18440182&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:44:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18575415&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:44:47 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18466435&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:44:51 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365882&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:44:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18535370&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:44:59 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372009&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:45:02 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365184&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:45:05 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365355&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:45:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2025-03-03 00:45:06 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108
2025-03-03 00:45:06 [scrapy.extensions.logstats] INFO: Crawled 69 pages (at 2 pages/min), scraped 229 items (at 5 items/min)
2025-03-03 00:45:09 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18363082&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:45:13 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18577108&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:45:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18632303&page=1> (referer: None)
2025-03-03 00:45:18 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Defence Colony', 'platform': 'zomato', 'res_id': 18632303, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962658, 'download_latency': 0.8058056831359863, 'depth': 0}
2025-03-03 00:45:18 [reviews] INFO: Scraped item: {'review': 'loved the packaging\U0001faf6🏻 and the biryani was too good to be true!! recommended!!!', 'review_id': 282168857, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Defence Colony', 'platform': 'zomato', 'res_id': 18632303}
2025-03-03 00:45:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18632303&page=1>
{'review': 'loved the packaging\U0001faf6🏻 and the biryani was too good to be true!! recommended!!!', 'review_id': 282168857, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Defence Colony', 'platform': 'zomato', 'res_id': 18632303}
2025-03-03 00:45:18 [reviews] INFO: Scraped item: {'review': 'Amazing packing amazing food excellent service thanks', 'review_id': 281194444, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Defence Colony', 'platform': 'zomato', 'res_id': 18632303}
2025-03-03 00:45:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18632303&page=1>
{'review': 'Amazing packing amazing food excellent service thanks', 'review_id': 281194444, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Defence Colony', 'platform': 'zomato', 'res_id': 18632303}
2025-03-03 00:45:18 [reviews] INFO: Stopping for res_id: 18632303 as reviews are older than 7 days.
2025-03-03 00:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18650200&page=1> (referer: None)
2025-03-03 00:45:22 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 49, 'brand_name': 'Pa Pa Ya', 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18650200, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962660, 'download_latency': 0.8170781135559082, 'depth': 0}
2025-03-03 00:45:22 [reviews] INFO: Scraped item: {'review': 'The food was stale and had fungus . And they did not even', 'review_id': 282059723, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 49, 'brand_name': 'Pa Pa Ya', 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18650200}
2025-03-03 00:45:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18650200&page=1>
{'review': 'The food was stale and had fungus . And they did not even', 'review_id': 282059723, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 49, 'brand_name': 'Pa Pa Ya', 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18650200}
2025-03-03 00:45:22 [reviews] INFO: Stopping for res_id: 18650200 as reviews are older than 7 days.
2025-03-03 00:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18658316&page=1> (referer: None)
2025-03-03 00:45:26 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962666, 'download_latency': 0.7789921760559082, 'depth': 0}
2025-03-03 00:45:26 [reviews] INFO: Scraped item: {'review': 'Good service by Rajni', 'review_id': 282083903, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316}
2025-03-03 00:45:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18658316&page=1>
{'review': 'Good service by Rajni', 'review_id': 282083903, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316}
2025-03-03 00:45:26 [reviews] INFO: Scraped item: {'review': 'appreciate the food and services provided by staff. Rajni ji were helpful.', 'review_id': 282011074, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316}
2025-03-03 00:45:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18658316&page=1>
{'review': 'appreciate the food and services provided by staff. Rajni ji were helpful.', 'review_id': 282011074, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316}
2025-03-03 00:45:26 [reviews] INFO: Scraped item: {'review': 'Great food and excellent hospitality!!<br/>Thanks to Ravikant Ji and other staff!!', 'review_id': 281846575, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316}
2025-03-03 00:45:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18658316&page=1>
{'review': 'Great food and excellent hospitality!!<br/>Thanks to Ravikant Ji and other staff!!', 'review_id': 281846575, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316}
2025-03-03 00:45:26 [reviews] INFO: Scraped item: {'review': 'gy', 'review_id': 281833271, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316}
2025-03-03 00:45:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18658316&page=1>
{'review': 'gy', 'review_id': 281833271, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316}
2025-03-03 00:45:26 [reviews] INFO: Scraped item: {'review': 'great experience over bbk cp , good ambience and good , mr mohit greeted us very well , i would surely recommend biryani over this place, kebabs were ok ok . ', 'review_id': 281818262, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316}
2025-03-03 00:45:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18658316&page=1>
{'review': 'great experience over bbk cp , good ambience and good , mr mohit greeted us very well , i would surely recommend biryani over this place, kebabs were ok ok . ', 'review_id': 281818262, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316}
2025-03-03 00:45:30 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582431&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:45:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582428&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:45:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18547628&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:45:39 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18440182&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:45:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18575415&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:45:45 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18466435&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:45:48 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365882&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:45:52 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18535370&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:45:57 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372009&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18665842&page=1> (referer: None)
2025-03-03 00:46:01 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962703, 'download_latency': 0.7686479091644287, 'depth': 0}
2025-03-03 00:46:01 [reviews] INFO: Scraped item: {'review': 'Undercooked', 'review_id': 280542159, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842}
2025-03-03 00:46:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18665842&page=1>
{'review': 'Undercooked', 'review_id': 280542159, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842}
2025-03-03 00:46:01 [reviews] INFO: Scraped item: {'review': '', 'review_id': 280512149, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842}
2025-03-03 00:46:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18665842&page=1>
{'review': '', 'review_id': 280512149, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842}
2025-03-03 00:46:01 [reviews] INFO: Scraped item: {'review': 'very tasty food ', 'review_id': 280496509, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842}
2025-03-03 00:46:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18665842&page=1>
{'review': 'very tasty food ', 'review_id': 280496509, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842}
2025-03-03 00:46:01 [reviews] INFO: Scraped item: {'review': 'chicken was raw', 'review_id': 280336011, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842}
2025-03-03 00:46:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18665842&page=1>
{'review': 'chicken was raw', 'review_id': 280336011, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842}
2025-03-03 00:46:01 [reviews] INFO: Scraped item: {'review': '', 'review_id': 280265584, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842}
2025-03-03 00:46:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18665842&page=1>
{'review': '', 'review_id': 280265584, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842}
2025-03-03 00:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18669449&page=1> (referer: None)
2025-03-03 00:46:06 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18669449, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962706, 'download_latency': 0.8536784648895264, 'depth': 0}
2025-03-03 00:46:06 [reviews] INFO: Scraped item: {'review': 'chicken gravy was so so so tasty and laccha paratha too', 'review_id': 282005140, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18669449}
2025-03-03 00:46:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18669449&page=1>
{'review': 'chicken gravy was so so so tasty and laccha paratha too', 'review_id': 282005140, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18669449}
2025-03-03 00:46:06 [reviews] INFO: Scraped item: {'review': 'how come this much will serve 2? ', 'review_id': 280545406, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18669449}
2025-03-03 00:46:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18669449&page=1>
{'review': 'how come this much will serve 2? ', 'review_id': 280545406, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18669449}
2025-03-03 00:46:06 [reviews] INFO: Stopping for res_id: 18669449 as reviews are older than 7 days.
2025-03-03 00:46:06 [scrapy.extensions.logstats] INFO: Crawled 74 pages (at 5 pages/min), scraped 244 items (at 15 items/min)
2025-03-03 00:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18670791&page=1> (referer: None)
2025-03-03 00:46:08 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962710, 'download_latency': 0.7743465900421143, 'depth': 0}
2025-03-03 00:46:08 [reviews] INFO: Scraped item: {'review': "didn't felt the spice and the the taste wasn't exciting but Quality of Rice and chicken was Good ", 'review_id': 282194236, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791}
2025-03-03 00:46:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18670791&page=1>
{'review': "didn't felt the spice and the the taste wasn't exciting but Quality of Rice and chicken was Good ", 'review_id': 282194236, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791}
2025-03-03 00:46:08 [reviews] INFO: Scraped item: {'review': 'very disappointed ', 'review_id': 281845239, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791}
2025-03-03 00:46:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18670791&page=1>
{'review': 'very disappointed ', 'review_id': 281845239, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791}
2025-03-03 00:46:08 [reviews] INFO: Scraped item: {'review': 'Very unclean pieces, only bones', 'review_id': 281739439, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791}
2025-03-03 00:46:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18670791&page=1>
{'review': 'Very unclean pieces, only bones', 'review_id': 281739439, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791}
2025-03-03 00:46:08 [reviews] INFO: Scraped item: {'review': 'shalimar fried rice is disaster ', 'review_id': 281458505, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791}
2025-03-03 00:46:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18670791&page=1>
{'review': 'shalimar fried rice is disaster ', 'review_id': 281458505, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791}
2025-03-03 00:46:08 [reviews] INFO: Scraped item: {'review': '', 'review_id': 280804107, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791}
2025-03-03 00:46:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18670791&page=1>
{'review': '', 'review_id': 280804107, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791}
2025-03-03 00:46:11 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18577108&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18687928&page=1> (referer: None)
2025-03-03 00:46:16 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962718, 'download_latency': 0.7918441295623779, 'depth': 0}
2025-03-03 00:46:16 [reviews] INFO: Scraped item: {'review': 'The taste was not at all good', 'review_id': 280124903, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928}
2025-03-03 00:46:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18687928&page=1>
{'review': 'The taste was not at all good', 'review_id': 280124903, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928}
2025-03-03 00:46:16 [reviews] INFO: Stopping for res_id: 18687928 as reviews are older than 7 days.
2025-03-03 00:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18729345&page=1> (referer: None)
2025-03-03 00:46:21 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 18729345, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962723, 'download_latency': 0.824303388595581, 'depth': 0}
2025-03-03 00:46:21 [reviews] INFO: Scraped item: {'review': 'worst biryani ever,,,, rice was in small pieces and chicken and rice were too dried .. worst ever ', 'review_id': 281142891, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 18729345}
2025-03-03 00:46:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18729345&page=1>
{'review': 'worst biryani ever,,,, rice was in small pieces and chicken and rice were too dried .. worst ever ', 'review_id': 281142891, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 18729345}
2025-03-03 00:46:21 [reviews] INFO: Scraped item: {'review': 'Rice was dry and tasted bad', 'review_id': 280529295, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 18729345}
2025-03-03 00:46:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18729345&page=1>
{'review': 'Rice was dry and tasted bad', 'review_id': 280529295, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 18729345}
2025-03-03 00:46:21 [reviews] INFO: Stopping for res_id: 18729345 as reviews are older than 7 days.
2025-03-03 00:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18733959&page=1> (referer: None)
2025-03-03 00:46:24 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai ', 'sub_zone': 'Palladium Mall, Lower Parel', 'platform': 'zomato', 'res_id': 18733959, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962727, 'download_latency': 0.8144142627716064, 'depth': 0}
2025-03-03 00:46:24 [reviews] INFO: Scraped item: {'review': 'Food has to be salted not without salt .', 'review_id': 280493087, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai ', 'sub_zone': 'Palladium Mall, Lower Parel', 'platform': 'zomato', 'res_id': 18733959}
2025-03-03 00:46:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18733959&page=1>
{'review': 'Food has to be salted not without salt .', 'review_id': 280493087, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai ', 'sub_zone': 'Palladium Mall, Lower Parel', 'platform': 'zomato', 'res_id': 18733959}
2025-03-03 00:46:24 [reviews] INFO: Stopping for res_id: 18733959 as reviews are older than 7 days.
2025-03-03 00:46:28 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18658316&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:46:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582431&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:46:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582428&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:46:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18547628&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:46:44 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18575415&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:46:48 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18466435&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:46:52 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18440182&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:46:55 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18535370&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18735687&page=1> (referer: None)
2025-03-03 00:47:00 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962757, 'download_latency': 1.7827510833740234, 'depth': 0}
2025-03-03 00:47:00 [reviews] INFO: Scraped item: {'review': 'Took too much time at restaurant', 'review_id': 282122443, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687}
2025-03-03 00:47:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18735687&page=1>
{'review': 'Took too much time at restaurant', 'review_id': 282122443, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687}
2025-03-03 00:47:00 [reviews] INFO: Scraped item: {'review': 'Very poor quality, not fresh that too on Sunday!', 'review_id': 282047423, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687}
2025-03-03 00:47:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18735687&page=1>
{'review': 'Very poor quality, not fresh that too on Sunday!', 'review_id': 282047423, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687}
2025-03-03 00:47:00 [reviews] INFO: Scraped item: {'review': 'Overfried chicken', 'review_id': 281942398, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687}
2025-03-03 00:47:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18735687&page=1>
{'review': 'Overfried chicken', 'review_id': 281942398, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687}
2025-03-03 00:47:00 [reviews] INFO: Scraped item: {'review': 'most delicious mutton biryani I ever had I Mumbai ', 'review_id': 281782983, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687}
2025-03-03 00:47:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18735687&page=1>
{'review': 'most delicious mutton biryani I ever had I Mumbai ', 'review_id': 281782983, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687}
2025-03-03 00:47:00 [reviews] INFO: Scraped item: {'review': 'quantity bahut kam diye<br/><br/>mutton kabsa <br/><br/>mutton nalli ki pics bhi kam the is  tandoori mein masala nahin salad vagaira bhi bahut kam diye is bar har bar order karte hain itna khana to aap log ko dekh kar to bhejna chahie agar yahi Raha to main dobara order yahan se nahin karungi ab se', 'review_id': 281586951, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687}
2025-03-03 00:47:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18735687&page=1>
{'review': 'quantity bahut kam diye<br/><br/>mutton kabsa <br/><br/>mutton nalli ki pics bhi kam the is  tandoori mein masala nahin salad vagaira bhi bahut kam diye is bar har bar order karte hain itna khana to aap log ko dekh kar to bhejna chahie agar yahi Raha to main dobara order yahan se nahin karungi ab se', 'review_id': 281586951, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687}
2025-03-03 00:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18746991&page=1> (referer: None)
2025-03-03 00:47:04 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962761, 'download_latency': 0.7428655624389648, 'depth': 0}
2025-03-03 00:47:04 [reviews] INFO: Scraped item: {'review': 'stale food<br/>and smells bad <br/>very bad experience from zomato ', 'review_id': 282269074, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991}
2025-03-03 00:47:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18746991&page=1>
{'review': 'stale food<br/>and smells bad <br/>very bad experience from zomato ', 'review_id': 282269074, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991}
2025-03-03 00:47:04 [reviews] INFO: Scraped item: {'review': 'taste wise so so', 'review_id': 282247284, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991}
2025-03-03 00:47:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18746991&page=1>
{'review': 'taste wise so so', 'review_id': 282247284, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991}
2025-03-03 00:47:04 [reviews] INFO: Scraped item: {'review': 'not worth the money. too salty and artificial taste', 'review_id': 282235258, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991}
2025-03-03 00:47:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18746991&page=1>
{'review': 'not worth the money. too salty and artificial taste', 'review_id': 282235258, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991}
2025-03-03 00:47:04 [reviews] INFO: Scraped item: {'review': 'quality was very less..more salty', 'review_id': 281366807, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991}
2025-03-03 00:47:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18746991&page=1>
{'review': 'quality was very less..more salty', 'review_id': 281366807, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991}
2025-03-03 00:47:04 [reviews] INFO: Scraped item: {'review': 'best biryani fresh & tasty ', 'review_id': 281214014, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991}
2025-03-03 00:47:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18746991&page=1>
{'review': 'best biryani fresh & tasty ', 'review_id': 281214014, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991}
2025-03-03 00:47:06 [scrapy.extensions.logstats] INFO: Crawled 80 pages (at 6 pages/min), scraped 263 items (at 19 items/min)
2025-03-03 00:47:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18665842&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18780110&page=1> (referer: None)
2025-03-03 00:47:10 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962769, 'download_latency': 0.7898292541503906, 'depth': 0}
2025-03-03 00:47:10 [reviews] INFO: Scraped item: {'review': 'faltu bhai ekdam faltu ', 'review_id': 282271930, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110}
2025-03-03 00:47:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18780110&page=1>
{'review': 'faltu bhai ekdam faltu ', 'review_id': 282271930, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110}
2025-03-03 00:47:10 [reviews] INFO: Scraped item: {'review': "Veg noodles didn't have any vegetables. It was tasteless and masala shikanji was yuck .", 'review_id': 282141727, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110}
2025-03-03 00:47:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18780110&page=1>
{'review': "Veg noodles didn't have any vegetables. It was tasteless and masala shikanji was yuck .", 'review_id': 282141727, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110}
2025-03-03 00:47:10 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281867091, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110}
2025-03-03 00:47:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18780110&page=1>
{'review': '', 'review_id': 281867091, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110}
2025-03-03 00:47:10 [reviews] INFO: Scraped item: {'review': 'Food was not tasty and it was cold... not happy', 'review_id': 281806943, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110}
2025-03-03 00:47:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18780110&page=1>
{'review': 'Food was not tasty and it was cold... not happy', 'review_id': 281806943, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110}
2025-03-03 00:47:10 [reviews] INFO: Scraped item: {'review': 'food is cold ', 'review_id': 281762473, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110}
2025-03-03 00:47:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18780110&page=1>
{'review': 'food is cold ', 'review_id': 281762473, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110}
2025-03-03 00:47:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18670791&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:47:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18577108&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18789443&page=1> (referer: None)
2025-03-03 00:47:20 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Navi Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 18789443, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962781, 'download_latency': 0.7862772941589355, 'depth': 0}
2025-03-03 00:47:20 [reviews] INFO: Scraped item: {'review': 'rice needs to cook more ', 'review_id': 282251245, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Navi Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 18789443}
2025-03-03 00:47:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18789443&page=1>
{'review': 'rice needs to cook more ', 'review_id': 282251245, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Navi Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 18789443}
2025-03-03 00:47:20 [reviews] INFO: Scraped item: {'review': 'undercooked veg momos.<br/>Tasted as if I was eating raw dough with grass stuffing. I expected better Chinese wok ', 'review_id': 281841458, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Navi Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 18789443}
2025-03-03 00:47:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18789443&page=1>
{'review': 'undercooked veg momos.<br/>Tasted as if I was eating raw dough with grass stuffing. I expected better Chinese wok ', 'review_id': 281841458, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Navi Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 18789443}
2025-03-03 00:47:20 [reviews] INFO: Scraped item: {'review': "It did not meet the expectations, neither the taste nor the quality. Noodles were too thick and chicken was supposed to be spicy, which they weren't. I wouldn't recommend it to any of my friends. The taste was subpar at best", 'review_id': 281094164, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Navi Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 18789443}
2025-03-03 00:47:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18789443&page=1>
{'review': "It did not meet the expectations, neither the taste nor the quality. Noodles were too thick and chicken was supposed to be spicy, which they weren't. I wouldn't recommend it to any of my friends. The taste was subpar at best", 'review_id': 281094164, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Navi Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 18789443}
2025-03-03 00:47:20 [reviews] INFO: Scraped item: {'review': 'soup and rice had a weird smell', 'review_id': 280278907, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Navi Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 18789443}
2025-03-03 00:47:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18789443&page=1>
{'review': 'soup and rice had a weird smell', 'review_id': 280278907, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Navi Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 18789443}
2025-03-03 00:47:20 [reviews] INFO: Stopping for res_id: 18789443 as reviews are older than 7 days.
2025-03-03 00:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18806648&page=1> (referer: None)
2025-03-03 00:47:23 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962785, 'download_latency': 0.7879014015197754, 'depth': 0}
2025-03-03 00:47:23 [reviews] INFO: Scraped item: {'review': 'Super liked the hand written note...appreciate the personal touch included in the platter.', 'review_id': 281931344, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648}
2025-03-03 00:47:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18806648&page=1>
{'review': 'Super liked the hand written note...appreciate the personal touch included in the platter.', 'review_id': 281931344, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648}
2025-03-03 00:47:23 [reviews] INFO: Scraped item: {'review': 'soya chaap biryani me namak nhi tha aur Kam spicy thi', 'review_id': 281842778, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648}
2025-03-03 00:47:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18806648&page=1>
{'review': 'soya chaap biryani me namak nhi tha aur Kam spicy thi', 'review_id': 281842778, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648}
2025-03-03 00:47:23 [reviews] INFO: Scraped item: {'review': 'i did not received my order. It was marked delivered but not to me. However the Zomato agent helped me with the refund.', 'review_id': 281163429, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648}
2025-03-03 00:47:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18806648&page=1>
{'review': 'i did not received my order. It was marked delivered but not to me. However the Zomato agent helped me with the refund.', 'review_id': 281163429, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648}
2025-03-03 00:47:23 [reviews] INFO: Scraped item: {'review': 'I have ordered chicken Biryani but they give me only rice. Worst restaurant ever', 'review_id': 280971365, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648}
2025-03-03 00:47:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18806648&page=1>
{'review': 'I have ordered chicken Biryani but they give me only rice. Worst restaurant ever', 'review_id': 280971365, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648}
2025-03-03 00:47:23 [reviews] INFO: Scraped item: {'review': 'too much spicy 🔥', 'review_id': 280525221, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648}
2025-03-03 00:47:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18806648&page=1>
{'review': 'too much spicy 🔥', 'review_id': 280525221, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648}
2025-03-03 00:47:26 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18658316&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:47:29 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582431&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:47:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582428&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:47:35 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18547628&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:47:39 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18575415&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18852839&page=1> (referer: None)
2025-03-03 00:47:43 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962808, 'download_latency': 0.7089946269989014, 'depth': 0}
2025-03-03 00:47:43 [reviews] INFO: Scraped item: {'review': 'super', 'review_id': 282155071, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839}
2025-03-03 00:47:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18852839&page=1>
{'review': 'super', 'review_id': 282155071, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839}
2025-03-03 00:47:43 [reviews] INFO: Scraped item: {'review': 'cooking request not followed ', 'review_id': 281934288, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839}
2025-03-03 00:47:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18852839&page=1>
{'review': 'cooking request not followed ', 'review_id': 281934288, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839}
2025-03-03 00:47:43 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281604271, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839}
2025-03-03 00:47:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18852839&page=1>
{'review': '', 'review_id': 281604271, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839}
2025-03-03 00:47:43 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281477838, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839}
2025-03-03 00:47:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18852839&page=1>
{'review': '', 'review_id': 281477838, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839}
2025-03-03 00:47:43 [reviews] INFO: Scraped item: {'review': 'Loved the extra green chillies in the biryani and was very flavourful, very much recommended for that Kerala twist to it', 'review_id': 280904414, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839}
2025-03-03 00:47:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18852839&page=1>
{'review': 'Loved the extra green chillies in the biryani and was very flavourful, very much recommended for that Kerala twist to it', 'review_id': 280904414, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839}
2025-03-03 00:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18887194&page=1> (referer: None)
2025-03-03 00:47:46 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 18887194, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962812, 'download_latency': 0.7529282569885254, 'depth': 0}
2025-03-03 00:47:46 [reviews] INFO: Scraped item: {'review': 'highly highly recommended, the Persia darbar is a perfect place for tasty food delight, I ordered veg fried rice and cold drink, taste of rice was so good, deserve the money which I paid. loved it. would definitely love to order again soon.', 'review_id': 282231144, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 18887194}
2025-03-03 00:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18887194&page=1>
{'review': 'highly highly recommended, the Persia darbar is a perfect place for tasty food delight, I ordered veg fried rice and cold drink, taste of rice was so good, deserve the money which I paid. loved it. would definitely love to order again soon.', 'review_id': 282231144, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 18887194}
2025-03-03 00:47:46 [reviews] INFO: Scraped item: {'review': 'The veg hakka noodles were so good, it was so authentic and amazing in taste, it was perfect in taste, not so spicy . highly recommended . ', 'review_id': 282227033, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 18887194}
2025-03-03 00:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18887194&page=1>
{'review': 'The veg hakka noodles were so good, it was so authentic and amazing in taste, it was perfect in taste, not so spicy . highly recommended . ', 'review_id': 282227033, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 18887194}
2025-03-03 00:47:46 [reviews] INFO: Scraped item: {'review': 'only 4 pc of chicken was there ', 'review_id': 282181874, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 18887194}
2025-03-03 00:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18887194&page=1>
{'review': 'only 4 pc of chicken was there ', 'review_id': 282181874, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 18887194}
2025-03-03 00:47:46 [reviews] INFO: Scraped item: {'review': "there were 3 teaspoons of oil and also the quantity of boneless mutton pieces and gravy doesn't justify the price.", 'review_id': 282103331, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 18887194}
2025-03-03 00:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18887194&page=1>
{'review': "there were 3 teaspoons of oil and also the quantity of boneless mutton pieces and gravy doesn't justify the price.", 'review_id': 282103331, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 18887194}
2025-03-03 00:47:46 [reviews] INFO: Scraped item: {'review': 'only a few chicken pieces are there ', 'review_id': 282042384, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 18887194}
2025-03-03 00:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18887194&page=1>
{'review': 'only a few chicken pieces are there ', 'review_id': 282042384, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 18887194}
2025-03-03 00:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18934094&page=1> (referer: None)
2025-03-03 00:47:50 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962816, 'download_latency': 0.7273669242858887, 'depth': 0}
2025-03-03 00:47:50 [reviews] INFO: Scraped item: {'review': 'it was perfect', 'review_id': 281939109, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094}
2025-03-03 00:47:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18934094&page=1>
{'review': 'it was perfect', 'review_id': 281939109, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094}
2025-03-03 00:47:50 [reviews] INFO: Scraped item: {'review': "Biryani was very delicious and special thanks to neeraj who fulfilled my all requirement's..much recommended", 'review_id': 281900797, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094}
2025-03-03 00:47:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18934094&page=1>
{'review': "Biryani was very delicious and special thanks to neeraj who fulfilled my all requirement's..much recommended", 'review_id': 281900797, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094}
2025-03-03 00:47:50 [reviews] INFO: Scraped item: {'review': 'Best biryani', 'review_id': 281867298, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094}
2025-03-03 00:47:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18934094&page=1>
{'review': 'Best biryani', 'review_id': 281867298, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094}
2025-03-03 00:47:50 [reviews] INFO: Scraped item: {'review': 'Mutton should have been more soft.', 'review_id': 281780253, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094}
2025-03-03 00:47:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18934094&page=1>
{'review': 'Mutton should have been more soft.', 'review_id': 281780253, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094}
2025-03-03 00:47:50 [reviews] INFO: Scraped item: {'review': 'Very tasty excellent experience', 'review_id': 281761602, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094}
2025-03-03 00:47:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18934094&page=1>
{'review': 'Very tasty excellent experience', 'review_id': 281761602, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094}
2025-03-03 00:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18939360&page=1> (referer: None)
2025-03-03 00:47:53 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 71, 'brand_name': "Raju's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18939360, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962821, 'download_latency': 0.7394964694976807, 'depth': 0}
2025-03-03 00:47:53 [reviews] INFO: Scraped item: {'review': 'I asked for extra schezwan and fried noodles', 'review_id': 282241141, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 71, 'brand_name': "Raju's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18939360}
2025-03-03 00:47:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18939360&page=1>
{'review': 'I asked for extra schezwan and fried noodles', 'review_id': 282241141, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 71, 'brand_name': "Raju's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18939360}
2025-03-03 00:47:53 [reviews] INFO: Scraped item: {'review': 'looting people <br/>', 'review_id': 281486434, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 71, 'brand_name': "Raju's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18939360}
2025-03-03 00:47:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18939360&page=1>
{'review': 'looting people <br/>', 'review_id': 281486434, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 71, 'brand_name': "Raju's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18939360}
2025-03-03 00:47:53 [reviews] INFO: Stopping for res_id: 18939360 as reviews are older than 7 days.
2025-03-03 00:47:56 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18735687&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:48:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18746991&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:48:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18665842&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:48:06 [scrapy.extensions.logstats] INFO: Crawled 87 pages (at 7 pages/min), scraped 294 items (at 31 items/min)
2025-03-03 00:48:06 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18780110&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:48:09 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18670791&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:48:12 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18577108&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18997398&page=1> (referer: None)
2025-03-03 00:48:16 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18997398, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962844, 'download_latency': 0.7225008010864258, 'depth': 0}
2025-03-03 00:48:16 [reviews] INFO: Scraped item: {'review': "It took more than one hour for delivery. As it was cash on delivery discount was not applicable. The biryani too wasn't up to the mark.", 'review_id': 281991125, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18997398}
2025-03-03 00:48:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18997398&page=1>
{'review': "It took more than one hour for delivery. As it was cash on delivery discount was not applicable. The biryani too wasn't up to the mark.", 'review_id': 281991125, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18997398}
2025-03-03 00:48:16 [reviews] INFO: Scraped item: {'review': 'qty very less', 'review_id': 281442204, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18997398}
2025-03-03 00:48:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18997398&page=1>
{'review': 'qty very less', 'review_id': 281442204, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18997398}
2025-03-03 00:48:16 [reviews] INFO: Scraped item: {'review': 'bland...looks like they forgot to add masala...', 'review_id': 281338807, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18997398}
2025-03-03 00:48:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18997398&page=1>
{'review': 'bland...looks like they forgot to add masala...', 'review_id': 281338807, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18997398}
2025-03-03 00:48:16 [reviews] INFO: Scraped item: {'review': 'I did not get the delivery ', 'review_id': 281290472, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18997398}
2025-03-03 00:48:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18997398&page=1>
{'review': 'I did not get the delivery ', 'review_id': 281290472, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18997398}
2025-03-03 00:48:16 [reviews] INFO: Scraped item: {'review': 'half handi quantity given', 'review_id': 280339058, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18997398}
2025-03-03 00:48:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18997398&page=1>
{'review': 'half handi quantity given', 'review_id': 280339058, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18997398}
2025-03-03 00:48:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18806648&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:48:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18658316&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:48:28 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582431&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:48:32 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582428&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19022949&page=1> (referer: None)
2025-03-03 00:48:37 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Castle Mill', 'platform': 'zomato', 'res_id': 19022949, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962859, 'download_latency': 0.7808935642242432, 'depth': 0}
2025-03-03 00:48:37 [reviews] INFO: Scraped item: {'review': 'worst biryani no taste at all was hoping for good experience but disappointed 😔 😞 ', 'review_id': 281726899, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Castle Mill', 'platform': 'zomato', 'res_id': 19022949}
2025-03-03 00:48:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19022949&page=1>
{'review': 'worst biryani no taste at all was hoping for good experience but disappointed 😔 😞 ', 'review_id': 281726899, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Castle Mill', 'platform': 'zomato', 'res_id': 19022949}
2025-03-03 00:48:37 [reviews] INFO: Scraped item: {'review': 'worst biryani ever, dried rice , 4 pieces of paneer, no masala at all and overpriced. no taste except that of khada masala, never gonna order from Behrouz Biryani ever and highly not recommended ', 'review_id': 280974948, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Castle Mill', 'platform': 'zomato', 'res_id': 19022949}
2025-03-03 00:48:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19022949&page=1>
{'review': 'worst biryani ever, dried rice , 4 pieces of paneer, no masala at all and overpriced. no taste except that of khada masala, never gonna order from Behrouz Biryani ever and highly not recommended ', 'review_id': 280974948, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Castle Mill', 'platform': 'zomato', 'res_id': 19022949}
2025-03-03 00:48:37 [reviews] INFO: Stopping for res_id: 19022949 as reviews are older than 7 days.
2025-03-03 00:48:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19104625&page=1> (referer: None)
2025-03-03 00:48:40 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962863, 'download_latency': 0.6736092567443848, 'depth': 0}
2025-03-03 00:48:40 [reviews] INFO: Scraped item: {'review': 'My veg biryani has piece of non veg in it.I am going to sue this outlet and zomato both. You must remove this brand from your application.', 'review_id': 281712197, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625}
2025-03-03 00:48:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19104625&page=1>
{'review': 'My veg biryani has piece of non veg in it.I am going to sue this outlet and zomato both. You must remove this brand from your application.', 'review_id': 281712197, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625}
2025-03-03 00:48:40 [reviews] INFO: Scraped item: {'review': 'Loved it', 'review_id': 281397012, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625}
2025-03-03 00:48:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19104625&page=1>
{'review': 'Loved it', 'review_id': 281397012, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625}
2025-03-03 00:48:40 [reviews] INFO: Scraped item: {'review': 'food instruction not followed', 'review_id': 281378463, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625}
2025-03-03 00:48:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19104625&page=1>
{'review': 'food instruction not followed', 'review_id': 281378463, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625}
2025-03-03 00:48:40 [reviews] INFO: Scraped item: {'review': 'excellent biryani ', 'review_id': 281004032, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625}
2025-03-03 00:48:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19104625&page=1>
{'review': 'excellent biryani ', 'review_id': 281004032, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625}
2025-03-03 00:48:40 [reviews] INFO: Scraped item: {'review': 'just biriyani name joking, not this biriyani ok , just froad ', 'review_id': 280821719, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625}
2025-03-03 00:48:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19104625&page=1>
{'review': 'just biriyani name joking, not this biriyani ok , just froad ', 'review_id': 280821719, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625}
2025-03-03 00:48:43 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18852839&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:48:47 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18887194&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:48:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18934094&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:48:53 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18735687&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:48:56 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18746991&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:48:59 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18665842&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:49:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18780110&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:49:05 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18670791&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:49:06 [scrapy.extensions.logstats] INFO: Crawled 90 pages (at 3 pages/min), scraped 306 items (at 12 items/min)
2025-03-03 00:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19119928&page=1> (referer: None)
2025-03-03 00:49:10 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962893, 'download_latency': 1.4469475746154785, 'depth': 0}
2025-03-03 00:49:10 [reviews] INFO: Scraped item: {'review': 'The burger was disappointing—it had skin on it, and part of the chicken was undercooked. Really unexpected from Boojee.', 'review_id': 282138957, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928}
2025-03-03 00:49:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19119928&page=1>
{'review': 'The burger was disappointing—it had skin on it, and part of the chicken was undercooked. Really unexpected from Boojee.', 'review_id': 282138957, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928}
2025-03-03 00:49:10 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281878800, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928}
2025-03-03 00:49:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19119928&page=1>
{'review': '', 'review_id': 281878800, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928}
2025-03-03 00:49:10 [reviews] INFO: Scraped item: {'review': "Absolutely love the Vietnamese coffee! It's perfect and delicious!!", 'review_id': 281867385, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928}
2025-03-03 00:49:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19119928&page=1>
{'review': "Absolutely love the Vietnamese coffee! It's perfect and delicious!!", 'review_id': 281867385, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928}
2025-03-03 00:49:10 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281709800, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928}
2025-03-03 00:49:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19119928&page=1>
{'review': '', 'review_id': 281709800, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928}
2025-03-03 00:49:10 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281240180, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928}
2025-03-03 00:49:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19119928&page=1>
{'review': '', 'review_id': 281240180, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928}
2025-03-03 00:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19123522&page=1> (referer: None)
2025-03-03 00:49:14 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 45, 'brand_name': 'The Shaka Cafe', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19123522, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962897, 'download_latency': 0.6114940643310547, 'depth': 0}
2025-03-03 00:49:14 [reviews] INFO: Scraped item: {'review': 'Visited this place, and we ordered vegan customised food pizza, bao everything was extremely delicious…. The support staff was gracious and Imranji helped us choose specifically!! Loved every bit', 'review_id': 282172939, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 45, 'brand_name': 'The Shaka Cafe', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19123522}
2025-03-03 00:49:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19123522&page=1>
{'review': 'Visited this place, and we ordered vegan customised food pizza, bao everything was extremely delicious…. The support staff was gracious and Imranji helped us choose specifically!! Loved every bit', 'review_id': 282172939, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 45, 'brand_name': 'The Shaka Cafe', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19123522}
2025-03-03 00:49:14 [reviews] INFO: Scraped item: {'review': "the food is fresh and tasty <br/>imraan and whole team of shaka are very courteous <br/>they made changes to the dishes we ordered so my friend  can eat as she's a vegan.", 'review_id': 282161448, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 45, 'brand_name': 'The Shaka Cafe', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19123522}
2025-03-03 00:49:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19123522&page=1>
{'review': "the food is fresh and tasty <br/>imraan and whole team of shaka are very courteous <br/>they made changes to the dishes we ordered so my friend  can eat as she's a vegan.", 'review_id': 282161448, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 45, 'brand_name': 'The Shaka Cafe', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19123522}
2025-03-03 00:49:14 [reviews] INFO: Scraped item: {'review': 'The food was extremely delicious and staff including Imranji suggested us special customization… suggest all to come with family', 'review_id': 282161190, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 45, 'brand_name': 'The Shaka Cafe', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19123522}
2025-03-03 00:49:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19123522&page=1>
{'review': 'The food was extremely delicious and staff including Imranji suggested us special customization… suggest all to come with family', 'review_id': 282161190, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 45, 'brand_name': 'The Shaka Cafe', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19123522}
2025-03-03 00:49:14 [reviews] INFO: Scraped item: {'review': 'There was an insect in the food', 'review_id': 281945017, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 45, 'brand_name': 'The Shaka Cafe', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19123522}
2025-03-03 00:49:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19123522&page=1>
{'review': 'There was an insect in the food', 'review_id': 281945017, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 45, 'brand_name': 'The Shaka Cafe', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19123522}
2025-03-03 00:49:14 [reviews] INFO: Scraped item: {'review': 'I requested no bak choy', 'review_id': 281555213, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 45, 'brand_name': 'The Shaka Cafe', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19123522}
2025-03-03 00:49:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19123522&page=1>
{'review': 'I requested no bak choy', 'review_id': 281555213, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 45, 'brand_name': 'The Shaka Cafe', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19123522}
2025-03-03 00:49:17 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18997398&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:49:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18806648&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:49:25 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18658316&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:49:29 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582431&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19142873&page=1> (referer: None)
2025-03-03 00:49:34 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 38, 'brand_name': 'Lavonne', 'city': 'Bangalore', 'sub_zone': 'St. Marks Road', 'platform': 'zomato', 'res_id': 19142873, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962917, 'download_latency': 0.6611676216125488, 'depth': 0}
2025-03-03 00:49:34 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281417132, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 38, 'brand_name': 'Lavonne', 'city': 'Bangalore', 'sub_zone': 'St. Marks Road', 'platform': 'zomato', 'res_id': 19142873}
2025-03-03 00:49:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19142873&page=1>
{'review': '', 'review_id': 281417132, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 38, 'brand_name': 'Lavonne', 'city': 'Bangalore', 'sub_zone': 'St. Marks Road', 'platform': 'zomato', 'res_id': 19142873}
2025-03-03 00:49:34 [reviews] INFO: Scraped item: {'review': 'Our new fav place! Loved the service from yoses, he was very efficient and immediately catered to all our needs. Thank you for making our dining experience memorable :)', 'review_id': 280896509, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-02-27', 'competitor_id': 38, 'brand_name': 'Lavonne', 'city': 'Bangalore', 'sub_zone': 'St. Marks Road', 'platform': 'zomato', 'res_id': 19142873}
2025-03-03 00:49:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19142873&page=1>
{'review': 'Our new fav place! Loved the service from yoses, he was very efficient and immediately catered to all our needs. Thank you for making our dining experience memorable :)', 'review_id': 280896509, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-02-27', 'competitor_id': 38, 'brand_name': 'Lavonne', 'city': 'Bangalore', 'sub_zone': 'St. Marks Road', 'platform': 'zomato', 'res_id': 19142873}
2025-03-03 00:49:34 [reviews] INFO: Scraped item: {'review': '', 'review_id': 280492789, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 38, 'brand_name': 'Lavonne', 'city': 'Bangalore', 'sub_zone': 'St. Marks Road', 'platform': 'zomato', 'res_id': 19142873}
2025-03-03 00:49:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19142873&page=1>
{'review': '', 'review_id': 280492789, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 38, 'brand_name': 'Lavonne', 'city': 'Bangalore', 'sub_zone': 'St. Marks Road', 'platform': 'zomato', 'res_id': 19142873}
2025-03-03 00:49:34 [reviews] INFO: Stopping for res_id: 19142873 as reviews are older than 7 days.
2025-03-03 00:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19168838&page=1> (referer: None)
2025-03-03 00:49:37 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962920, 'download_latency': 0.6048052310943604, 'depth': 0}
2025-03-03 00:49:37 [reviews] INFO: Scraped item: {'review': 'The rice was mushed up due steam and I feel that the chicken in Hyderabadi biryani was slightly uncooked.', 'review_id': 281980130, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838}
2025-03-03 00:49:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19168838&page=1>
{'review': 'The rice was mushed up due steam and I feel that the chicken in Hyderabadi biryani was slightly uncooked.', 'review_id': 281980130, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838}
2025-03-03 00:49:37 [reviews] INFO: Scraped item: {'review': 'Food was good 👍', 'review_id': 280967603, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838}
2025-03-03 00:49:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19168838&page=1>
{'review': 'Food was good 👍', 'review_id': 280967603, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838}
2025-03-03 00:49:37 [reviews] INFO: Scraped item: {'review': '', 'review_id': 280861806, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838}
2025-03-03 00:49:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19168838&page=1>
{'review': '', 'review_id': 280861806, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838}
2025-03-03 00:49:37 [reviews] INFO: Scraped item: {'review': 'Food was very Good 👍', 'review_id': 280820982, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838}
2025-03-03 00:49:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19168838&page=1>
{'review': 'Food was very Good 👍', 'review_id': 280820982, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838}
2025-03-03 00:49:37 [reviews] INFO: Scraped item: {'review': 'Amazing food. ', 'review_id': 280815070, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838}
2025-03-03 00:49:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19168838&page=1>
{'review': 'Amazing food. ', 'review_id': 280815070, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838}
2025-03-03 00:49:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19104625&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:49:44 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18887194&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:49:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18934094&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:49:53 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18852839&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:49:56 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18746991&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:50:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18735687&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:50:04 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18780110&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:50:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2025-03-03 00:50:06 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108
2025-03-03 00:50:06 [scrapy.extensions.logstats] INFO: Crawled 94 pages (at 4 pages/min), scraped 324 items (at 18 items/min)
2025-03-03 00:50:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18670791&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:50:11 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18665842&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:50:15 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19119928&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:50:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19123522&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:50:21 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18997398&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:50:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18806648&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:50:28 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18658316&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:50:31 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582431&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19180777&page=1> (referer: None)
2025-03-03 00:50:36 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740962977, 'download_latency': 1.4863505363464355, 'depth': 0}
2025-03-03 00:50:36 [reviews] INFO: Scraped item: {'review': 'Taste less.waste of money. And quantity is too much less compare to amount', 'review_id': 282267212, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777}
2025-03-03 00:50:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19180777&page=1>
{'review': 'Taste less.waste of money. And quantity is too much less compare to amount', 'review_id': 282267212, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777}
2025-03-03 00:50:36 [reviews] INFO: Scraped item: {'review': 'Awesome taste. Value for money', 'review_id': 281934098, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777}
2025-03-03 00:50:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19180777&page=1>
{'review': 'Awesome taste. Value for money', 'review_id': 281934098, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777}
2025-03-03 00:50:36 [reviews] INFO: Scraped item: {'review': 'very bad taste', 'review_id': 281857631, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777}
2025-03-03 00:50:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19180777&page=1>
{'review': 'very bad taste', 'review_id': 281857631, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777}
2025-03-03 00:50:36 [reviews] INFO: Scraped item: {'review': 'Over salted and no spone', 'review_id': 281855652, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777}
2025-03-03 00:50:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19180777&page=1>
{'review': 'Over salted and no spone', 'review_id': 281855652, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777}
2025-03-03 00:50:36 [reviews] INFO: Scraped item: {'review': 'Panner biryani was well cooked. Veg dun biryani with well seasoned potatoes and veggies. Good job hope they will keep the taste. ', 'review_id': 281764955, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777}
2025-03-03 00:50:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19180777&page=1>
{'review': 'Panner biryani was well cooked. Veg dun biryani with well seasoned potatoes and veggies. Good job hope they will keep the taste. ', 'review_id': 281764955, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777}
2025-03-03 00:50:39 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19168838&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:50:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19104625&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:50:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18934094&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:50:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18852839&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:50:52 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18887194&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:50:56 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18735687&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:51:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18780110&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:51:05 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18746991&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:51:06 [scrapy.extensions.logstats] INFO: Crawled 95 pages (at 1 pages/min), scraped 329 items (at 5 items/min)
2025-03-03 00:51:09 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18665842&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:51:13 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19119928&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:51:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19123522&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:51:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18997398&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:51:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18806648&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:51:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18670791&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:51:31 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18658316&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:51:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19194488&page=1> (referer: None)
2025-03-03 00:51:36 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 19194488, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963037, 'download_latency': 1.6384427547454834, 'depth': 0}
2025-03-03 00:51:36 [reviews] INFO: Scraped item: {'review': 'Very less chicken and very less paneer in biryani', 'review_id': 282003794, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 19194488}
2025-03-03 00:51:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19194488&page=1>
{'review': 'Very less chicken and very less paneer in biryani', 'review_id': 282003794, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 19194488}
2025-03-03 00:51:36 [reviews] INFO: Scraped item: {'review': 'quantity is less<br/>biriani not good at all as Hyderabadi biriani<br/>less pieces. <br/>bikkange biryani is better than this biryani for price and quality.<br/>size of pieces sucks very small', 'review_id': 281950762, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 19194488}
2025-03-03 00:51:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19194488&page=1>
{'review': 'quantity is less<br/>biriani not good at all as Hyderabadi biriani<br/>less pieces. <br/>bikkange biryani is better than this biryani for price and quality.<br/>size of pieces sucks very small', 'review_id': 281950762, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 19194488}
2025-03-03 00:51:36 [reviews] INFO: Scraped item: {'review': 'Biryani and kathal pieces were flavorful. Potatoes should be replaced with cauliflower, carrot, or any other veggies, as the potatoes absorb too much masala n salt, making them avoidable.', 'review_id': 281609456, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 19194488}
2025-03-03 00:51:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19194488&page=1>
{'review': 'Biryani and kathal pieces were flavorful. Potatoes should be replaced with cauliflower, carrot, or any other veggies, as the potatoes absorb too much masala n salt, making them avoidable.', 'review_id': 281609456, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 19194488}
2025-03-03 00:51:36 [reviews] INFO: Scraped item: {'review': 'Veg platter was amazing. Biryani was dry and way too much rice compared to chicken', 'review_id': 281393149, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 19194488}
2025-03-03 00:51:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19194488&page=1>
{'review': 'Veg platter was amazing. Biryani was dry and way too much rice compared to chicken', 'review_id': 281393149, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 19194488}
2025-03-03 00:51:36 [reviews] INFO: Scraped item: {'review': 'Very overcooked biryani. Not worth the price paid.', 'review_id': 281316821, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 19194488}
2025-03-03 00:51:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19194488&page=1>
{'review': 'Very overcooked biryani. Not worth the price paid.', 'review_id': 281316821, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 19194488}
2025-03-03 00:51:37 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19180777&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:51:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19168838&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:51:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19104625&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:51:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18852839&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:51:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18887194&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:51:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18934094&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:52:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18780110&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:52:06 [scrapy.extensions.logstats] INFO: Crawled 96 pages (at 1 pages/min), scraped 334 items (at 5 items/min)
2025-03-03 00:52:06 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18746991&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:52:10 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18735687&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:52:12 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19119928&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:52:17 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19123522&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:52:21 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18997398&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:52:25 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18806648&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:52:29 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18670791&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:52:33 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18665842&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:52:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19195026&page=1> (referer: None)
2025-03-03 00:52:38 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963097, 'download_latency': 1.6468002796173096, 'depth': 0}
2025-03-03 00:52:38 [reviews] INFO: Scraped item: {'review': 'Average taste', 'review_id': 282259224, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026}
2025-03-03 00:52:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19195026&page=1>
{'review': 'Average taste', 'review_id': 282259224, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026}
2025-03-03 00:52:38 [reviews] INFO: Scraped item: {'review': 'only presentation, worst biryani taste I ever tasted. ', 'review_id': 281424165, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026}
2025-03-03 00:52:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19195026&page=1>
{'review': 'only presentation, worst biryani taste I ever tasted. ', 'review_id': 281424165, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026}
2025-03-03 00:52:38 [reviews] INFO: Scraped item: {'review': 'Excellent as always taste and quality nobody can match right now by any biryani partner', 'review_id': 281285233, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026}
2025-03-03 00:52:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19195026&page=1>
{'review': 'Excellent as always taste and quality nobody can match right now by any biryani partner', 'review_id': 281285233, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026}
2025-03-03 00:52:38 [reviews] INFO: Scraped item: {'review': 'Wrong Biryani delivered...had ordered boneless', 'review_id': 281086737, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026}
2025-03-03 00:52:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19195026&page=1>
{'review': 'Wrong Biryani delivered...had ordered boneless', 'review_id': 281086737, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026}
2025-03-03 00:52:38 [reviews] INFO: Scraped item: {'review': 'only 2 small pieces of chicken that too not tasty', 'review_id': 280955174, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026}
2025-03-03 00:52:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19195026&page=1>
{'review': 'only 2 small pieces of chicken that too not tasty', 'review_id': 280955174, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026}
2025-03-03 00:52:39 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19194488&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:52:43 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19180777&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:52:47 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19168838&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:52:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19104625&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:52:53 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18887194&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:52:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18934094&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:53:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18852839&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:53:06 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18746991&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:53:06 [scrapy.extensions.logstats] INFO: Crawled 97 pages (at 1 pages/min), scraped 339 items (at 5 items/min)
2025-03-03 00:53:10 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18735687&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:53:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19119928&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:53:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19123522&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:53:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18997398&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:53:26 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18806648&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:53:31 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18780110&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:53:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19205663&page=1> (referer: None)
2025-03-03 00:53:37 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'K Star Mall', 'platform': 'zomato', 'res_id': 19205663, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963153, 'download_latency': 2.004190683364868, 'depth': 0}
2025-03-03 00:53:37 [reviews] INFO: Stopping for res_id: 19205663 as reviews are older than 7 days.
2025-03-03 00:53:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19207047&page=1> (referer: None)
2025-03-03 00:53:40 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 32, 'brand_name': 'Third Wave Coffee', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19207047, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963159, 'download_latency': 1.221210241317749, 'depth': 0}
2025-03-03 00:53:40 [reviews] INFO: Scraped item: {'review': 'order is not correct u give wrong 1 order to me and one off my friend no drink coffee wt can we do now ', 'review_id': 281570746, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 32, 'brand_name': 'Third Wave Coffee', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19207047}
2025-03-03 00:53:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19207047&page=1>
{'review': 'order is not correct u give wrong 1 order to me and one off my friend no drink coffee wt can we do now ', 'review_id': 281570746, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 32, 'brand_name': 'Third Wave Coffee', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19207047}
2025-03-03 00:53:40 [reviews] INFO: Stopping for res_id: 19207047 as reviews are older than 7 days.
2025-03-03 00:53:43 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19195026&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:53:47 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19194488&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:53:51 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19180777&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:53:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19168838&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:53:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19104625&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:54:01 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18934094&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:54:03 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18852839&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:54:06 [scrapy.extensions.logstats] INFO: Crawled 99 pages (at 2 pages/min), scraped 340 items (at 1 items/min)
2025-03-03 00:54:07 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18887194&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19247726&page=1> (referer: None)
2025-03-03 00:54:12 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 12, 'brand_name': 'Kuai Kitchen', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19247726, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963190, 'download_latency': 1.417724370956421, 'depth': 0}
2025-03-03 00:54:12 [reviews] INFO: Scraped item: {'review': 'I ordered last evening and while the food was delicious, the portion size was much smaller than expected, especially for the price. It didn’t feel like good value for money. Forget the box being full, it was literally not even quarter of the box filled. I hope you can review your portion sizes to ensure a better experience for customers. Looking forward to improvements in future orders !', 'review_id': 280883828, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 12, 'brand_name': 'Kuai Kitchen', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19247726}
2025-03-03 00:54:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19247726&page=1>
{'review': 'I ordered last evening and while the food was delicious, the portion size was much smaller than expected, especially for the price. It didn’t feel like good value for money. Forget the box being full, it was literally not even quarter of the box filled. I hope you can review your portion sizes to ensure a better experience for customers. Looking forward to improvements in future orders !', 'review_id': 280883828, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 12, 'brand_name': 'Kuai Kitchen', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19247726}
2025-03-03 00:54:12 [reviews] INFO: Stopping for res_id: 19247726 as reviews are older than 7 days.
2025-03-03 00:54:15 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19119928&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:54:19 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19123522&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:54:24 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18997398&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19257266&page=1> (referer: None)
2025-03-03 00:54:29 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963207, 'download_latency': 1.305537462234497, 'depth': 0}
2025-03-03 00:54:29 [reviews] INFO: Scraped item: {'review': 'It was already half eaten', 'review_id': 280945906, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266}
2025-03-03 00:54:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19257266&page=1>
{'review': 'It was already half eaten', 'review_id': 280945906, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266}
2025-03-03 00:54:29 [reviews] INFO: Scraped item: {'review': "last night i visited to order the cake they said it's close it was around 11:15 pm but you can order online from swiggy and zomato I didn't understand  how does it matter I request them to I will pay then and there please pack  they totally denied I didn't understand the logic if we will order online they can packed but if you go to store and order they'll not packed totally waste of time and they don't have sense to run the store i would suggest you(owner) please train  your staff or close your store don't be unprofessional being a hospitality industry.", 'review_id': 280945584, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-02-27', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266}
2025-03-03 00:54:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19257266&page=1>
{'review': "last night i visited to order the cake they said it's close it was around 11:15 pm but you can order online from swiggy and zomato I didn't understand  how does it matter I request them to I will pay then and there please pack  they totally denied I didn't understand the logic if we will order online they can packed but if you go to store and order they'll not packed totally waste of time and they don't have sense to run the store i would suggest you(owner) please train  your staff or close your store don't be unprofessional being a hospitality industry.", 'review_id': 280945584, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-02-27', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266}
2025-03-03 00:54:29 [reviews] INFO: Scraped item: {'review': 'Good: Chocolate cakes. Pretty much all of them. Devil’s Chocolate Cake is pure heaven.<br/><br/>Bad: Coffee is pretty average and the salted caramel ice cream is too salty.<br/><br/>Ugly: Double shot cake. The butter cream is absolutely tasteless and there’s zero coffee flavor. It felt like a chore to eat it and we gagged a few times. Horrible!', 'review_id': 280519135, 'rating': '3', 'review_type': 'DINING', 'review_date': '2025-02-26', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266}
2025-03-03 00:54:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19257266&page=1>
{'review': 'Good: Chocolate cakes. Pretty much all of them. Devil’s Chocolate Cake is pure heaven.<br/><br/>Bad: Coffee is pretty average and the salted caramel ice cream is too salty.<br/><br/>Ugly: Double shot cake. The butter cream is absolutely tasteless and there’s zero coffee flavor. It felt like a chore to eat it and we gagged a few times. Horrible!', 'review_id': 280519135, 'rating': '3', 'review_type': 'DINING', 'review_date': '2025-02-26', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266}
2025-03-03 00:54:29 [reviews] INFO: Scraped item: {'review': 'What kinda crap have you guys sent us for 400 bucks? What I saw on Instagram and the quantity of pudding was so massive. What have you  guys even sent us? Peanuts? Useless people. All you know to do is scam people for their money', 'review_id': 280388060, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266}
2025-03-03 00:54:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19257266&page=1>
{'review': 'What kinda crap have you guys sent us for 400 bucks? What I saw on Instagram and the quantity of pudding was so massive. What have you  guys even sent us? Peanuts? Useless people. All you know to do is scam people for their money', 'review_id': 280388060, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266}
2025-03-03 00:54:29 [reviews] INFO: Scraped item: {'review': '', 'review_id': 280276821, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266}
2025-03-03 00:54:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19257266&page=1>
{'review': '', 'review_id': 280276821, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266}
2025-03-03 00:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19270163&page=1> (referer: None)
2025-03-03 00:54:33 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 52, 'brand_name': 'The Flaming Bowl', 'city': 'Kolkata', 'sub_zone': 'Bhawanipur', 'platform': 'zomato', 'res_id': 19270163, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963211, 'download_latency': 1.131603717803955, 'depth': 0}
2025-03-03 00:54:33 [reviews] INFO: Scraped item: {'review': 'amazing place to have veg food. This is now my go to place. Reasonable prices', 'review_id': 281606578, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 52, 'brand_name': 'The Flaming Bowl', 'city': 'Kolkata', 'sub_zone': 'Bhawanipur', 'platform': 'zomato', 'res_id': 19270163}
2025-03-03 00:54:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19270163&page=1>
{'review': 'amazing place to have veg food. This is now my go to place. Reasonable prices', 'review_id': 281606578, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 52, 'brand_name': 'The Flaming Bowl', 'city': 'Kolkata', 'sub_zone': 'Bhawanipur', 'platform': 'zomato', 'res_id': 19270163}
2025-03-03 00:54:33 [reviews] INFO: Stopping for res_id: 19270163 as reviews are older than 7 days.
2025-03-03 00:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19295012&page=1> (referer: None)
2025-03-03 00:54:36 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 19295012, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963217, 'download_latency': 1.0181219577789307, 'depth': 0}
2025-03-03 00:54:36 [reviews] INFO: Scraped item: {'review': 'the expectations of biryani was too high as per the price, but it was nothing but just simply pulaow with some minimal non veg pieces ', 'review_id': 282020626, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 19295012}
2025-03-03 00:54:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19295012&page=1>
{'review': 'the expectations of biryani was too high as per the price, but it was nothing but just simply pulaow with some minimal non veg pieces ', 'review_id': 282020626, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 19295012}
2025-03-03 00:54:36 [reviews] INFO: Scraped item: {'review': 'I paid Rs-251 for this chicken left out cooked in bache huye masale and gire huye capcicum. Pics is also misleading ', 'review_id': 281767593, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 19295012}
2025-03-03 00:54:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19295012&page=1>
{'review': 'I paid Rs-251 for this chicken left out cooked in bache huye masale and gire huye capcicum. Pics is also misleading ', 'review_id': 281767593, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 19295012}
2025-03-03 00:54:36 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281137792, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 19295012}
2025-03-03 00:54:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19295012&page=1>
{'review': '', 'review_id': 281137792, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 19295012}
2025-03-03 00:54:36 [reviews] INFO: Stopping for res_id: 19295012 as reviews are older than 7 days.
2025-03-03 00:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19338435&page=1> (referer: None)
2025-03-03 00:54:40 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 19338435, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963221, 'download_latency': 0.8648762702941895, 'depth': 0}
2025-03-03 00:54:40 [reviews] INFO: Scraped item: {'review': 'The delivery man Was very Polite..', 'review_id': 282186265, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 19338435}
2025-03-03 00:54:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19338435&page=1>
{'review': 'The delivery man Was very Polite..', 'review_id': 282186265, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 19338435}
2025-03-03 00:54:40 [reviews] INFO: Stopping for res_id: 19338435 as reviews are older than 7 days.
2025-03-03 00:54:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19195026&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:54:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19194488&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:54:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19180777&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:54:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19168838&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:54:58 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19104625&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19347326&page=1> (referer: None)
2025-03-03 00:55:01 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 19347326, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963241, 'download_latency': 1.3239309787750244, 'depth': 0}
2025-03-03 00:55:01 [reviews] INFO: Scraped item: {'review': 'awesome ,made our day', 'review_id': 281533244, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 19347326}
2025-03-03 00:55:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19347326&page=1>
{'review': 'awesome ,made our day', 'review_id': 281533244, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 19347326}
2025-03-03 00:55:01 [reviews] INFO: Stopping for res_id: 19347326 as reviews are older than 7 days.
2025-03-03 00:55:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19470793&page=1> (referer: None)
2025-03-03 00:55:04 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963244, 'download_latency': 0.9760632514953613, 'depth': 0}
2025-03-03 00:55:04 [reviews] INFO: Scraped item: {'review': 'Recently I ordered veg fried rice from here, the quality and the quantity both were great, the rice was perfectly prepared and gulab jamun was so delicious and yummy. must try', 'review_id': 282230283, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793}
2025-03-03 00:55:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19470793&page=1>
{'review': 'Recently I ordered veg fried rice from here, the quality and the quantity both were great, the rice was perfectly prepared and gulab jamun was so delicious and yummy. must try', 'review_id': 282230283, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793}
2025-03-03 00:55:04 [reviews] INFO: Scraped item: {'review': 'The veg spring rolls were crispy , and amazing, the quality was super good and quantity was just enough for two. loved the taste', 'review_id': 282226239, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793}
2025-03-03 00:55:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19470793&page=1>
{'review': 'The veg spring rolls were crispy , and amazing, the quality was super good and quantity was just enough for two. loved the taste', 'review_id': 282226239, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793}
2025-03-03 00:55:04 [reviews] INFO: Scraped item: {'review': "There is hair in the biryani i found and I did complaint also but than also I don't get any cal from restaurant.", 'review_id': 282118777, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793}
2025-03-03 00:55:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19470793&page=1>
{'review': "There is hair in the biryani i found and I did complaint also but than also I don't get any cal from restaurant.", 'review_id': 282118777, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793}
2025-03-03 00:55:04 [reviews] INFO: Scraped item: {'review': "Veg crispy was very spicy  which could not be consumed by elders in house.Veg Manchurian was good.Fried rice was too dry . I don't know how can you keep your rating if food is not tasting as per standard.", 'review_id': 281882460, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793}
2025-03-03 00:55:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19470793&page=1>
{'review': "Veg crispy was very spicy  which could not be consumed by elders in house.Veg Manchurian was good.Fried rice was too dry . I don't know how can you keep your rating if food is not tasting as per standard.", 'review_id': 281882460, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793}
2025-03-03 00:55:04 [reviews] INFO: Scraped item: {'review': 'After long years back I loved to had this authentic traditional biryani taste which I was  lost many years back. ', 'review_id': 281850132, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793}
2025-03-03 00:55:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19470793&page=1>
{'review': 'After long years back I loved to had this authentic traditional biryani taste which I was  lost many years back. ', 'review_id': 281850132, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793}
2025-03-03 00:55:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2025-03-03 00:55:06 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108
2025-03-03 00:55:06 [scrapy.extensions.logstats] INFO: Crawled 106 pages (at 7 pages/min), scraped 357 items (at 17 items/min)
2025-03-03 00:55:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19494939&page=1> (referer: None)
2025-03-03 00:55:09 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963247, 'download_latency': 0.912611722946167, 'depth': 0}
2025-03-03 00:55:09 [reviews] INFO: Scraped item: {'review': '', 'review_id': 282242465, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939}
2025-03-03 00:55:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19494939&page=1>
{'review': '', 'review_id': 282242465, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939}
2025-03-03 00:55:09 [reviews] INFO: Scraped item: {'review': 'Blood in chicken, pathetic for first time!', 'review_id': 282230186, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939}
2025-03-03 00:55:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19494939&page=1>
{'review': 'Blood in chicken, pathetic for first time!', 'review_id': 282230186, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939}
2025-03-03 00:55:09 [reviews] INFO: Scraped item: {'review': '', 'review_id': 282119254, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939}
2025-03-03 00:55:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19494939&page=1>
{'review': '', 'review_id': 282119254, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939}
2025-03-03 00:55:09 [reviews] INFO: Scraped item: {'review': 'Worst I got wrong order cheating on me I ordered 650 gems of boneless biryani but sent a bowl which is half my order', 'review_id': 281965752, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939}
2025-03-03 00:55:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19494939&page=1>
{'review': 'Worst I got wrong order cheating on me I ordered 650 gems of boneless biryani but sent a bowl which is half my order', 'review_id': 281965752, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939}
2025-03-03 00:55:09 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281828368, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939}
2025-03-03 00:55:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19494939&page=1>
{'review': '', 'review_id': 281828368, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939}
2025-03-03 00:55:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19497084&page=1> (referer: None)
2025-03-03 00:55:12 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963253, 'download_latency': 1.0348703861236572, 'depth': 0}
2025-03-03 00:55:12 [reviews] INFO: Scraped item: {'review': 'no taste in seekh kawab . worst experience ', 'review_id': 282206199, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084}
2025-03-03 00:55:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19497084&page=1>
{'review': 'no taste in seekh kawab . worst experience ', 'review_id': 282206199, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084}
2025-03-03 00:55:12 [reviews] INFO: Scraped item: {'review': '', 'review_id': 282038556, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084}
2025-03-03 00:55:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19497084&page=1>
{'review': '', 'review_id': 282038556, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084}
2025-03-03 00:55:12 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281966309, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084}
2025-03-03 00:55:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19497084&page=1>
{'review': '', 'review_id': 281966309, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084}
2025-03-03 00:55:12 [reviews] INFO: Scraped item: {'review': 'not good at all', 'review_id': 281858947, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084}
2025-03-03 00:55:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19497084&page=1>
{'review': 'not good at all', 'review_id': 281858947, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084}
2025-03-03 00:55:12 [reviews] INFO: Scraped item: {'review': 'Mera raita mising hai pura order nhi mila hai extra raita tha ak mila and dusra nhi mila hai', 'review_id': 281853098, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084}
2025-03-03 00:55:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19497084&page=1>
{'review': 'Mera raita mising hai pura order nhi mila hai extra raita tha ak mila and dusra nhi mila hai', 'review_id': 281853098, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084}
2025-03-03 00:55:14 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19119928&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:55:18 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19123522&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19512567&page=1> (referer: None)
2025-03-03 00:55:23 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963264, 'download_latency': 0.789161205291748, 'depth': 0}
2025-03-03 00:55:23 [reviews] INFO: Scraped item: {'review': "you guys forgot the 7up didn't you", 'review_id': 282245424, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567}
2025-03-03 00:55:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19512567&page=1>
{'review': "you guys forgot the 7up didn't you", 'review_id': 282245424, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567}
2025-03-03 00:55:23 [reviews] INFO: Scraped item: {'review': 'we ordered Shejwan Fried rice, whereas we received chilli fried rice and Noodles. Extremely spicy we are not able to even eat', 'review_id': 282221425, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567}
2025-03-03 00:55:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19512567&page=1>
{'review': 'we ordered Shejwan Fried rice, whereas we received chilli fried rice and Noodles. Extremely spicy we are not able to even eat', 'review_id': 282221425, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567}
2025-03-03 00:55:23 [reviews] INFO: Scraped item: {'review': 'Worst quality no test never order from this hotel', 'review_id': 281715723, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567}
2025-03-03 00:55:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19512567&page=1>
{'review': 'Worst quality no test never order from this hotel', 'review_id': 281715723, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567}
2025-03-03 00:55:23 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281623796, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567}
2025-03-03 00:55:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19512567&page=1>
{'review': '', 'review_id': 281623796, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567}
2025-03-03 00:55:23 [reviews] INFO: Scraped item: {'review': 'food was taste less. oversized ', 'review_id': 281478120, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567}
2025-03-03 00:55:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19512567&page=1>
{'review': 'food was taste less. oversized ', 'review_id': 281478120, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567}
2025-03-03 00:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19519013&page=1> (referer: None)
2025-03-03 00:55:27 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Noida', 'sub_zone': 'Chaukhandi', 'platform': 'zomato', 'res_id': 19519013, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963269, 'download_latency': 1.1141462326049805, 'depth': 0}
2025-03-03 00:55:27 [reviews] INFO: Stopping for res_id: 19519013 as reviews are older than 7 days.
2025-03-03 00:55:31 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19257266&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:55:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530561&page=1> (referer: None)
2025-03-03 00:55:35 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19530561, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963277, 'download_latency': 0.8848271369934082, 'depth': 0}
2025-03-03 00:55:35 [reviews] INFO: Scraped item: {'review': 'it was ice not gulab jamun I was not able to eat properly but rasmalai was too good to eat ', 'review_id': 282274681, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19530561}
2025-03-03 00:55:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530561&page=1>
{'review': 'it was ice not gulab jamun I was not able to eat properly but rasmalai was too good to eat ', 'review_id': 282274681, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19530561}
2025-03-03 00:55:35 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281929612, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19530561}
2025-03-03 00:55:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530561&page=1>
{'review': '', 'review_id': 281929612, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19530561}
2025-03-03 00:55:35 [reviews] INFO: Scraped item: {'review': 'Did not deliver Thums up... charged for same', 'review_id': 281498237, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19530561}
2025-03-03 00:55:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530561&page=1>
{'review': 'Did not deliver Thums up... charged for same', 'review_id': 281498237, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19530561}
2025-03-03 00:55:35 [reviews] INFO: Scraped item: {'review': 'The Galuti mutton roll was awesome.', 'review_id': 281432113, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19530561}
2025-03-03 00:55:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530561&page=1>
{'review': 'The Galuti mutton roll was awesome.', 'review_id': 281432113, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19530561}
2025-03-03 00:55:35 [reviews] INFO: Scraped item: {'review': 'as per the price is consent quality is good can be more better', 'review_id': 281376697, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19530561}
2025-03-03 00:55:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530561&page=1>
{'review': 'as per the price is consent quality is good can be more better', 'review_id': 281376697, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19530561}
2025-03-03 00:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530900&page=1> (referer: None)
2025-03-03 00:55:39 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963280, 'download_latency': 1.9442532062530518, 'depth': 0}
2025-03-03 00:55:39 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281912919, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900}
2025-03-03 00:55:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530900&page=1>
{'review': '', 'review_id': 281912919, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900}
2025-03-03 00:55:39 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281845733, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900}
2025-03-03 00:55:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530900&page=1>
{'review': '', 'review_id': 281845733, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900}
2025-03-03 00:55:39 [reviews] INFO: Scraped item: {'review': 'The curry tasted good but there was too much oil', 'review_id': 281071456, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900}
2025-03-03 00:55:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530900&page=1>
{'review': 'The curry tasted good but there was too much oil', 'review_id': 281071456, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900}
2025-03-03 00:55:39 [reviews] INFO: Stopping for res_id: 19530900 as reviews are older than 7 days.
2025-03-03 00:55:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19195026&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:55:45 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19194488&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:55:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19180777&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:55:52 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19168838&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531041&page=1> (referer: None)
2025-03-03 00:55:57 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963298, 'download_latency': 1.7880990505218506, 'depth': 0}
2025-03-03 00:55:57 [reviews] INFO: Scraped item: {'review': 'The taste was not at all good, I expected something better from Charcoal eats', 'review_id': 282201410, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041}
2025-03-03 00:55:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531041&page=1>
{'review': 'The taste was not at all good, I expected something better from Charcoal eats', 'review_id': 282201410, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041}
2025-03-03 00:55:57 [reviews] INFO: Scraped item: {'review': "don't order chicken was raw. I got salmonella poisoning from that", 'review_id': 281787107, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041}
2025-03-03 00:55:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531041&page=1>
{'review': "don't order chicken was raw. I got salmonella poisoning from that", 'review_id': 281787107, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041}
2025-03-03 00:55:57 [reviews] INFO: Scraped item: {'review': 'the gravy was not so great and was salty. they have given very thin malabari parathas and chapatis as roties. never expected this from our biryani favourite restaurant ', 'review_id': 281626286, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041}
2025-03-03 00:55:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531041&page=1>
{'review': 'the gravy was not so great and was salty. they have given very thin malabari parathas and chapatis as roties. never expected this from our biryani favourite restaurant ', 'review_id': 281626286, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041}
2025-03-03 00:55:57 [reviews] INFO: Scraped item: {'review': 'not  testy food ', 'review_id': 281292946, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041}
2025-03-03 00:55:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531041&page=1>
{'review': 'not  testy food ', 'review_id': 281292946, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041}
2025-03-03 00:55:57 [reviews] INFO: Scraped item: {'review': 'Excellent ', 'review_id': 281243775, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041}
2025-03-03 00:55:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531041&page=1>
{'review': 'Excellent ', 'review_id': 281243775, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041}
2025-03-03 00:55:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531051&page=1> (referer: None)
2025-03-03 00:55:59 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'City Mall', 'platform': 'zomato', 'res_id': 19531051, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963302, 'download_latency': 1.0608470439910889, 'depth': 0}
2025-03-03 00:55:59 [reviews] INFO: Scraped item: {'review': 'the chicken quality was not good', 'review_id': 281999530, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'City Mall', 'platform': 'zomato', 'res_id': 19531051}
2025-03-03 00:55:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531051&page=1>
{'review': 'the chicken quality was not good', 'review_id': 281999530, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'City Mall', 'platform': 'zomato', 'res_id': 19531051}
2025-03-03 00:55:59 [reviews] INFO: Scraped item: {'review': 'Not worth the price. Expensive.', 'review_id': 281947525, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'City Mall', 'platform': 'zomato', 'res_id': 19531051}
2025-03-03 00:55:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531051&page=1>
{'review': 'Not worth the price. Expensive.', 'review_id': 281947525, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'City Mall', 'platform': 'zomato', 'res_id': 19531051}
2025-03-03 00:55:59 [reviews] INFO: Scraped item: {'review': 'Poured Cream over the tandoor dishes & ruined it :-(', 'review_id': 281710606, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'City Mall', 'platform': 'zomato', 'res_id': 19531051}
2025-03-03 00:55:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531051&page=1>
{'review': 'Poured Cream over the tandoor dishes & ruined it :-(', 'review_id': 281710606, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'City Mall', 'platform': 'zomato', 'res_id': 19531051}
2025-03-03 00:55:59 [reviews] INFO: Scraped item: {'review': 'My stomach went upset', 'review_id': 281158573, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'City Mall', 'platform': 'zomato', 'res_id': 19531051}
2025-03-03 00:55:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531051&page=1>
{'review': 'My stomach went upset', 'review_id': 281158573, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'City Mall', 'platform': 'zomato', 'res_id': 19531051}
2025-03-03 00:55:59 [reviews] INFO: Scraped item: {'review': 'Best kathal biryani ever!', 'review_id': 280963544, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'City Mall', 'platform': 'zomato', 'res_id': 19531051}
2025-03-03 00:55:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531051&page=1>
{'review': 'Best kathal biryani ever!', 'review_id': 280963544, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'City Mall', 'platform': 'zomato', 'res_id': 19531051}
2025-03-03 00:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19542350&page=1> (referer: None)
2025-03-03 00:56:03 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 43, 'brand_name': 'Wok Sushi Bao', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19542350, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963305, 'download_latency': 1.0316989421844482, 'depth': 0}
2025-03-03 00:56:03 [reviews] INFO: Scraped item: {'review': 'I have been ordering regularly from Wok Sushi Bao and am substantially happy. Unfortunately since some time, the portion sizes have reduced quite a bit. Otherwise a five star affair', 'review_id': 281958809, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 43, 'brand_name': 'Wok Sushi Bao', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19542350}
2025-03-03 00:56:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19542350&page=1>
{'review': 'I have been ordering regularly from Wok Sushi Bao and am substantially happy. Unfortunately since some time, the portion sizes have reduced quite a bit. Otherwise a five star affair', 'review_id': 281958809, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 43, 'brand_name': 'Wok Sushi Bao', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19542350}
2025-03-03 00:56:03 [reviews] INFO: Scraped item: {'review': 'pathetic food😡, Sushi had meyo in it😭, who gives pineapple and chocolate sause with Chinese 👎 bao was less bao and more of mayo fake paneer and bread<br/><br/>not ordering again ever', 'review_id': 280945740, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 43, 'brand_name': 'Wok Sushi Bao', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19542350}
2025-03-03 00:56:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19542350&page=1>
{'review': 'pathetic food😡, Sushi had meyo in it😭, who gives pineapple and chocolate sause with Chinese 👎 bao was less bao and more of mayo fake paneer and bread<br/><br/>not ordering again ever', 'review_id': 280945740, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 43, 'brand_name': 'Wok Sushi Bao', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19542350}
2025-03-03 00:56:03 [reviews] INFO: Stopping for res_id: 19542350 as reviews are older than 7 days.
2025-03-03 00:56:04 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19470793&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:56:06 [scrapy.extensions.logstats] INFO: Crawled 115 pages (at 9 pages/min), scraped 392 items (at 35 items/min)
2025-03-03 00:56:08 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19494939&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:56:12 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19497084&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19542894&page=1> (referer: None)
2025-03-03 00:56:17 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963319, 'download_latency': 2.013392925262451, 'depth': 0}
2025-03-03 00:56:17 [reviews] INFO: Scraped item: {'review': 'Only 2 piece. Maximum Rice. Not happy with portion.', 'review_id': 282230078, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894}
2025-03-03 00:56:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19542894&page=1>
{'review': 'Only 2 piece. Maximum Rice. Not happy with portion.', 'review_id': 282230078, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894}
2025-03-03 00:56:17 [reviews] INFO: Scraped item: {'review': 'they are fraud <br/>they send the half the portion size ', 'review_id': 282136150, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894}
2025-03-03 00:56:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19542894&page=1>
{'review': 'they are fraud <br/>they send the half the portion size ', 'review_id': 282136150, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894}
2025-03-03 00:56:17 [reviews] INFO: Scraped item: {'review': 'chicken was undercooked and sweet side. asked for extra extra crispy. but roti was still under cooked. disappointed.', 'review_id': 281639285, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894}
2025-03-03 00:56:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19542894&page=1>
{'review': 'chicken was undercooked and sweet side. asked for extra extra crispy. but roti was still under cooked. disappointed.', 'review_id': 281639285, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894}
2025-03-03 00:56:17 [reviews] INFO: Scraped item: {'review': 'There no masala in biryani', 'review_id': 281462228, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894}
2025-03-03 00:56:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19542894&page=1>
{'review': 'There no masala in biryani', 'review_id': 281462228, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894}
2025-03-03 00:56:17 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281452409, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894}
2025-03-03 00:56:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19542894&page=1>
{'review': '', 'review_id': 281452409, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894}
2025-03-03 00:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19548251&page=1> (referer: None)
2025-03-03 00:56:20 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Matunga', 'platform': 'zomato', 'res_id': 19548251, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963323, 'download_latency': 1.2760777473449707, 'depth': 0}
2025-03-03 00:56:20 [reviews] INFO: Scraped item: {'review': 'Very bad, Fully loaded with red chillies', 'review_id': 280180027, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Matunga', 'platform': 'zomato', 'res_id': 19548251}
2025-03-03 00:56:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19548251&page=1>
{'review': 'Very bad, Fully loaded with red chillies', 'review_id': 280180027, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Matunga', 'platform': 'zomato', 'res_id': 19548251}
2025-03-03 00:56:20 [reviews] INFO: Stopping for res_id: 19548251 as reviews are older than 7 days.
2025-03-03 00:56:23 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19512567&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:56:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19257266&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19548739&page=1> (referer: None)
2025-03-03 00:56:30 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19548739, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963335, 'download_latency': 0.7722363471984863, 'depth': 0}
2025-03-03 00:56:30 [reviews] INFO: Scraped item: {'review': 'very Few Jackfruit pieces <br/>should contain more pieces ', 'review_id': 281735055, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19548739}
2025-03-03 00:56:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19548739&page=1>
{'review': 'very Few Jackfruit pieces <br/>should contain more pieces ', 'review_id': 281735055, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19548739}
2025-03-03 00:56:30 [reviews] INFO: Scraped item: {'review': 'It was okay, not very tasty but can be eaten', 'review_id': 280688895, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19548739}
2025-03-03 00:56:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19548739&page=1>
{'review': 'It was okay, not very tasty but can be eaten', 'review_id': 280688895, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19548739}
2025-03-03 00:56:30 [reviews] INFO: Scraped item: {'review': 'undercooked chicken ', 'review_id': 280395074, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19548739}
2025-03-03 00:56:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19548739&page=1>
{'review': 'undercooked chicken ', 'review_id': 280395074, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19548739}
2025-03-03 00:56:30 [reviews] INFO: Stopping for res_id: 19548739 as reviews are older than 7 days.
2025-03-03 00:56:34 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530561&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:56:37 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19195026&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:56:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19194488&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:56:44 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19180777&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19559682&page=1> (referer: None)
2025-03-03 00:56:49 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Juhu', 'platform': 'zomato', 'res_id': 19559682, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963353, 'download_latency': 1.0582003593444824, 'depth': 0}
2025-03-03 00:56:49 [reviews] INFO: Scraped item: {'review': 'I had an amazing experience with Sachin Patel at BBC. From the very first conversation, he understood my requirements perfectly and delivered the best Chicken Dum Biryani with just the right amount of masala. His politeness and willingness to listen, even during rush hours, truly reflect his dedication to his work and his commitment to serving the best food to customers. I’m really happy today, and it’s these small yet significant efforts that will surely make this outlet one of the best-rated BBC outlets in Mumbai. Kudos to Sachin for his excellent service! Highly recommended!', 'review_id': 281216321, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Juhu', 'platform': 'zomato', 'res_id': 19559682}
2025-03-03 00:56:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19559682&page=1>
{'review': 'I had an amazing experience with Sachin Patel at BBC. From the very first conversation, he understood my requirements perfectly and delivered the best Chicken Dum Biryani with just the right amount of masala. His politeness and willingness to listen, even during rush hours, truly reflect his dedication to his work and his commitment to serving the best food to customers. I’m really happy today, and it’s these small yet significant efforts that will surely make this outlet one of the best-rated BBC outlets in Mumbai. Kudos to Sachin for his excellent service! Highly recommended!', 'review_id': 281216321, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Juhu', 'platform': 'zomato', 'res_id': 19559682}
2025-03-03 00:56:49 [reviews] INFO: Scraped item: {'review': 'Okayish. Not spicy at all', 'review_id': 280814844, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Juhu', 'platform': 'zomato', 'res_id': 19559682}
2025-03-03 00:56:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19559682&page=1>
{'review': 'Okayish. Not spicy at all', 'review_id': 280814844, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Juhu', 'platform': 'zomato', 'res_id': 19559682}
2025-03-03 00:56:49 [reviews] INFO: Scraped item: {'review': "this restaurant doesn't know how to make a biryani. <br/>the biryani was chicken gravy covered with some rice. it seems to have been microwaved.<br/>the only reason to order was because of the reviews on youtube<br/>", 'review_id': 280803906, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Juhu', 'platform': 'zomato', 'res_id': 19559682}
2025-03-03 00:56:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19559682&page=1>
{'review': "this restaurant doesn't know how to make a biryani. <br/>the biryani was chicken gravy covered with some rice. it seems to have been microwaved.<br/>the only reason to order was because of the reviews on youtube<br/>", 'review_id': 280803906, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Juhu', 'platform': 'zomato', 'res_id': 19559682}
2025-03-03 00:56:49 [reviews] INFO: Scraped item: {'review': 'the butter chicken was spicier than usual making it difficult to eat.', 'review_id': 280641600, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Juhu', 'platform': 'zomato', 'res_id': 19559682}
2025-03-03 00:56:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19559682&page=1>
{'review': 'the butter chicken was spicier than usual making it difficult to eat.', 'review_id': 280641600, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Juhu', 'platform': 'zomato', 'res_id': 19559682}
2025-03-03 00:56:49 [reviews] INFO: Scraped item: {'review': 'paneer affected our stomach for all three of us.  vomiting and loose motion.', 'review_id': 280575427, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Juhu', 'platform': 'zomato', 'res_id': 19559682}
2025-03-03 00:56:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19559682&page=1>
{'review': 'paneer affected our stomach for all three of us.  vomiting and loose motion.', 'review_id': 280575427, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Juhu', 'platform': 'zomato', 'res_id': 19559682}
2025-03-03 00:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19562464&page=1> (referer: None)
2025-03-03 00:56:54 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963358, 'download_latency': 1.1196608543395996, 'depth': 0}
2025-03-03 00:56:54 [reviews] INFO: Scraped item: {'review': 'very bad below average biryani<br/> no taste, no aroma ...totally below average experience ', 'review_id': 282116704, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464}
2025-03-03 00:56:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19562464&page=1>
{'review': 'very bad below average biryani<br/> no taste, no aroma ...totally below average experience ', 'review_id': 282116704, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464}
2025-03-03 00:56:54 [reviews] INFO: Scraped item: {'review': 'Stale rancid biryani delivered under the guise of sale item. Absolutely pathetic from Charcoal. Thank god the kids did not eat this.<br/>Atrocious and pathetic move. Blacklisted this brand from my friends and family circle. ', 'review_id': 281816390, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464}
2025-03-03 00:56:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19562464&page=1>
{'review': 'Stale rancid biryani delivered under the guise of sale item. Absolutely pathetic from Charcoal. Thank god the kids did not eat this.<br/>Atrocious and pathetic move. Blacklisted this brand from my friends and family circle. ', 'review_id': 281816390, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464}
2025-03-03 00:56:54 [reviews] INFO: Scraped item: {'review': 'I got only one leg piece ', 'review_id': 281604426, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464}
2025-03-03 00:56:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19562464&page=1>
{'review': 'I got only one leg piece ', 'review_id': 281604426, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464}
2025-03-03 00:56:54 [reviews] INFO: Scraped item: {'review': 'Biryani was kind of pulav and very dry rice', 'review_id': 281493107, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464}
2025-03-03 00:56:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19562464&page=1>
{'review': 'Biryani was kind of pulav and very dry rice', 'review_id': 281493107, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464}
2025-03-03 00:56:54 [reviews] INFO: Scraped item: {'review': 'Delayed and food was not that warm anymore.', 'review_id': 281238628, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464}
2025-03-03 00:56:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19562464&page=1>
{'review': 'Delayed and food was not that warm anymore.', 'review_id': 281238628, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464}
2025-03-03 00:56:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531041&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:57:01 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531051&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:57:05 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19470793&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:57:06 [scrapy.extensions.logstats] INFO: Crawled 120 pages (at 5 pages/min), scraped 411 items (at 19 items/min)
2025-03-03 00:57:09 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19494939&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:57:13 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19497084&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:57:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19566888&page=1> (referer: None)
2025-03-03 00:57:18 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19566888, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963377, 'download_latency': 1.8416361808776855, 'depth': 0}
2025-03-03 00:57:18 [reviews] INFO: Stopping for res_id: 19566888 as reviews are older than 7 days.
2025-03-03 00:57:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19542894&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:57:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19512567&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:57:28 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19257266&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:57:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19570166&page=1> (referer: None)
2025-03-03 00:57:32 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963390, 'download_latency': 0.7051069736480713, 'depth': 0}
2025-03-03 00:57:32 [reviews] INFO: Scraped item: {'review': '', 'review_id': 282260397, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166}
2025-03-03 00:57:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19570166&page=1>
{'review': '', 'review_id': 282260397, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166}
2025-03-03 00:57:32 [reviews] INFO: Scraped item: {'review': 'I ordered chicken Biriyani but I got egg biriyani', 'review_id': 282167902, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166}
2025-03-03 00:57:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19570166&page=1>
{'review': 'I ordered chicken Biriyani but I got egg biriyani', 'review_id': 282167902, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166}
2025-03-03 00:57:32 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281783990, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166}
2025-03-03 00:57:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19570166&page=1>
{'review': '', 'review_id': 281783990, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166}
2025-03-03 00:57:32 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281621698, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166}
2025-03-03 00:57:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19570166&page=1>
{'review': '', 'review_id': 281621698, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166}
2025-03-03 00:57:32 [reviews] INFO: Scraped item: {'review': 'Very shauggy not crispy at all not up to the mark taste', 'review_id': 281558371, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166}
2025-03-03 00:57:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19570166&page=1>
{'review': 'Very shauggy not crispy at all not up to the mark taste', 'review_id': 281558371, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166}
2025-03-03 00:57:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530561&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:57:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19195026&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:57:43 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19194488&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:57:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19592218&page=1> (referer: None)
2025-03-03 00:57:48 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 11, 'brand_name': 'Royal China', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19592218, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963405, 'download_latency': 1.5517876148223877, 'depth': 0}
2025-03-03 00:57:48 [reviews] INFO: Scraped item: {'review': 'Burnt noodles', 'review_id': 281435689, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 11, 'brand_name': 'Royal China', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19592218}
2025-03-03 00:57:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19592218&page=1>
{'review': 'Burnt noodles', 'review_id': 281435689, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 11, 'brand_name': 'Royal China', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19592218}
2025-03-03 00:57:48 [reviews] INFO: Scraped item: {'review': 'No curtly delivered with the food.', 'review_id': 280628133, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 11, 'brand_name': 'Royal China', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19592218}
2025-03-03 00:57:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19592218&page=1>
{'review': 'No curtly delivered with the food.', 'review_id': 280628133, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 11, 'brand_name': 'Royal China', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19592218}
2025-03-03 00:57:48 [reviews] INFO: Stopping for res_id: 19592218 as reviews are older than 7 days.
2025-03-03 00:57:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19644926&page=1> (referer: None)
2025-03-03 00:57:51 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963410, 'download_latency': 0.7957155704498291, 'depth': 0}
2025-03-03 00:57:51 [reviews] INFO: Scraped item: {'review': 'Found 2 small pieces of stone in the food??', 'review_id': 282220791, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926}
2025-03-03 00:57:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19644926&page=1>
{'review': 'Found 2 small pieces of stone in the food??', 'review_id': 282220791, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926}
2025-03-03 00:57:51 [reviews] INFO: Scraped item: {'review': 'Mazda nhi aaya bilkul and I am being very honest.', 'review_id': 281737901, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926}
2025-03-03 00:57:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19644926&page=1>
{'review': 'Mazda nhi aaya bilkul and I am being very honest.', 'review_id': 281737901, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926}
2025-03-03 00:57:51 [reviews] INFO: Scraped item: {'review': 'The quantity is very low', 'review_id': 281584242, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926}
2025-03-03 00:57:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19644926&page=1>
{'review': 'The quantity is very low', 'review_id': 281584242, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926}
2025-03-03 00:57:51 [reviews] INFO: Scraped item: {'review': 'Not good taste, and quantity.', 'review_id': 281424949, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926}
2025-03-03 00:57:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19644926&page=1>
{'review': 'Not good taste, and quantity.', 'review_id': 281424949, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926}
2025-03-03 00:57:51 [reviews] INFO: Scraped item: {'review': 'v.nice Food', 'review_id': 280597245, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926}
2025-03-03 00:57:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19644926&page=1>
{'review': 'v.nice Food', 'review_id': 280597245, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926}
2025-03-03 00:57:55 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19559682&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:57:59 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19562464&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:58:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531051&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:58:06 [scrapy.extensions.logstats] INFO: Crawled 124 pages (at 4 pages/min), scraped 423 items (at 12 items/min)
2025-03-03 00:58:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531041&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:58:09 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19494939&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:58:13 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19497084&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:58:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19470793&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:58:19 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19542894&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:58:23 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19512567&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:58:26 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19257266&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:58:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19645023&page=1> (referer: None)
2025-03-03 00:58:30 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963453, 'download_latency': 0.7075371742248535, 'depth': 0}
2025-03-03 00:58:30 [reviews] INFO: Scraped item: {'review': 'mohan served us he was really polite and the service was amazing food was also amazing will definitely recommend it to others', 'review_id': 282176903, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023}
2025-03-03 00:58:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19645023&page=1>
{'review': 'mohan served us he was really polite and the service was amazing food was also amazing will definitely recommend it to others', 'review_id': 282176903, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023}
2025-03-03 00:58:30 [reviews] INFO: Scraped item: {'review': 'Amazing food. Excellent service by Nihaj', 'review_id': 282175132, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023}
2025-03-03 00:58:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19645023&page=1>
{'review': 'Amazing food. Excellent service by Nihaj', 'review_id': 282175132, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023}
2025-03-03 00:58:30 [reviews] INFO: Scraped item: {'review': 'Great service and recommendations by Gaurav. Totally recommend 💯', 'review_id': 282071789, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023}
2025-03-03 00:58:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19645023&page=1>
{'review': 'Great service and recommendations by Gaurav. Totally recommend 💯', 'review_id': 282071789, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023}
2025-03-03 00:58:30 [reviews] INFO: Scraped item: {'review': 'the staff Gaurav was helpfull..', 'review_id': 282033745, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023}
2025-03-03 00:58:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19645023&page=1>
{'review': 'the staff Gaurav was helpfull..', 'review_id': 282033745, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023}
2025-03-03 00:58:30 [reviews] INFO: Scraped item: {'review': 'Mohan was great', 'review_id': 282018788, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023}
2025-03-03 00:58:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19645023&page=1>
{'review': 'Mohan was great', 'review_id': 282018788, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023}
2025-03-03 00:58:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19570166&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:58:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530561&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:58:40 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19195026&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:58:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19646158&page=1> (referer: None)
2025-03-03 00:58:44 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 68, 'brand_name': 'Fat Monk Chinese', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 19646158, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963468, 'download_latency': 0.7547142505645752, 'depth': 0}
2025-03-03 00:58:44 [reviews] INFO: Scraped item: {'review': 'No sheswan chutney was provided', 'review_id': 281790085, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 68, 'brand_name': 'Fat Monk Chinese', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 19646158}
2025-03-03 00:58:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19646158&page=1>
{'review': 'No sheswan chutney was provided', 'review_id': 281790085, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 68, 'brand_name': 'Fat Monk Chinese', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 19646158}
2025-03-03 00:58:44 [reviews] INFO: Scraped item: {'review': "don't ever order. they don't follow instructions.<br/>taste and quality sucks. <br/>I wish I could give less then 1 star.", 'review_id': 281294880, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 68, 'brand_name': 'Fat Monk Chinese', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 19646158}
2025-03-03 00:58:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19646158&page=1>
{'review': "don't ever order. they don't follow instructions.<br/>taste and quality sucks. <br/>I wish I could give less then 1 star.", 'review_id': 281294880, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 68, 'brand_name': 'Fat Monk Chinese', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 19646158}
2025-03-03 00:58:44 [reviews] INFO: Scraped item: {'review': 'very good taste ', 'review_id': 281235687, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 68, 'brand_name': 'Fat Monk Chinese', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 19646158}
2025-03-03 00:58:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19646158&page=1>
{'review': 'very good taste ', 'review_id': 281235687, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 68, 'brand_name': 'Fat Monk Chinese', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 19646158}
2025-03-03 00:58:44 [reviews] INFO: Scraped item: {'review': 'Ordered to Lokmilan Complex n the food was amazing. Thank you, dear Chef. yummy schewan chicken fried rice n chili chicken gravy, ohh, not forgetting superb sushi. <br/>regards honest Review by Maria', 'review_id': 280848381, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 68, 'brand_name': 'Fat Monk Chinese', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 19646158}
2025-03-03 00:58:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19646158&page=1>
{'review': 'Ordered to Lokmilan Complex n the food was amazing. Thank you, dear Chef. yummy schewan chicken fried rice n chili chicken gravy, ohh, not forgetting superb sushi. <br/>regards honest Review by Maria', 'review_id': 280848381, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 68, 'brand_name': 'Fat Monk Chinese', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 19646158}
2025-03-03 00:58:44 [reviews] INFO: Scraped item: {'review': "Sorry to report fraud !! As I couldn't rech out on the restaurant number..!!", 'review_id': 280840118, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 68, 'brand_name': 'Fat Monk Chinese', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 19646158}
2025-03-03 00:58:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19646158&page=1>
{'review': "Sorry to report fraud !! As I couldn't rech out on the restaurant number..!!", 'review_id': 280840118, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 68, 'brand_name': 'Fat Monk Chinese', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 19646158}
2025-03-03 00:58:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19692864&page=1> (referer: None)
2025-03-03 00:58:47 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Kandivali', 'platform': 'zomato', 'res_id': 19692864, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963471, 'download_latency': 0.7410573959350586, 'depth': 0}
2025-03-03 00:58:47 [reviews] INFO: Scraped item: {'review': 'TOO MUCH OIL IS ARABIATIA PASTA......<br/>VERY VERY BAD........', 'review_id': 282121374, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Kandivali', 'platform': 'zomato', 'res_id': 19692864}
2025-03-03 00:58:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19692864&page=1>
{'review': 'TOO MUCH OIL IS ARABIATIA PASTA......<br/>VERY VERY BAD........', 'review_id': 282121374, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Kandivali', 'platform': 'zomato', 'res_id': 19692864}
2025-03-03 00:58:47 [reviews] INFO: Stopping for res_id: 19692864 as reviews are older than 7 days.
2025-03-03 00:58:48 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19644926&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:58:51 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19562464&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:58:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19559682&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:58:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531041&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:59:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531051&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:59:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19497084&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:59:06 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19470793&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:59:06 [scrapy.extensions.logstats] INFO: Crawled 127 pages (at 3 pages/min), scraped 434 items (at 11 items/min)
2025-03-03 00:59:09 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19542894&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:59:12 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19512567&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:59:15 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19494939&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:59:19 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19257266&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:59:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19645023&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:59:26 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19570166&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:59:30 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530561&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19709667&page=1> (referer: None)
2025-03-03 00:59:34 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963525, 'download_latency': 0.7346696853637695, 'depth': 0}
2025-03-03 00:59:34 [reviews] INFO: Scraped item: {'review': 'Best nachos ever , favourite place to hop in', 'review_id': 282211157, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667}
2025-03-03 00:59:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19709667&page=1>
{'review': 'Best nachos ever , favourite place to hop in', 'review_id': 282211157, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667}
2025-03-03 00:59:34 [reviews] INFO: Scraped item: {'review': 'very nice service by Sadik we enjoyed alot ', 'review_id': 282190328, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667}
2025-03-03 00:59:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19709667&page=1>
{'review': 'very nice service by Sadik we enjoyed alot ', 'review_id': 282190328, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667}
2025-03-03 00:59:34 [reviews] INFO: Scraped item: {'review': 'very good', 'review_id': 282011013, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667}
2025-03-03 00:59:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19709667&page=1>
{'review': 'very good', 'review_id': 282011013, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667}
2025-03-03 00:59:34 [reviews] INFO: Scraped item: {'review': 'Good taste', 'review_id': 281963531, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667}
2025-03-03 00:59:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19709667&page=1>
{'review': 'Good taste', 'review_id': 281963531, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667}
2025-03-03 00:59:34 [reviews] INFO: Scraped item: {'review': 'Very helpful staff, great food !', 'review_id': 281957289, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667}
2025-03-03 00:59:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19709667&page=1>
{'review': 'Very helpful staff, great food !', 'review_id': 281957289, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667}
2025-03-03 00:59:38 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19646158&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:59:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19644926&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:59:45 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19562464&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:59:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19559682&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:59:53 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531041&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 00:59:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531051&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:00:01 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19497084&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:00:05 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19470793&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:00:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2025-03-03 01:00:06 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108
2025-03-03 01:00:06 [scrapy.extensions.logstats] INFO: Crawled 128 pages (at 1 pages/min), scraped 439 items (at 5 items/min)
2025-03-03 01:00:09 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19542894&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:00:13 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19512567&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:00:17 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19494939&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:00:19 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19257266&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:00:23 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19645023&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:00:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19570166&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:00:29 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530561&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19745214&page=1> (referer: None)
2025-03-03 01:00:34 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963575, 'download_latency': 1.5208733081817627, 'depth': 0}
2025-03-03 01:00:34 [reviews] INFO: Scraped item: {'review': 'Very badly made chicken', 'review_id': 281993361, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214}
2025-03-03 01:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19745214&page=1>
{'review': 'Very badly made chicken', 'review_id': 281993361, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214}
2025-03-03 01:00:34 [reviews] INFO: Scraped item: {'review': 'veg Manchurian bowl too too salty. <br/>fritters/veg balls only flour, no veg.<br/>veg in the noodles v hard.  cabbage strips, carrot and onions too thick, hard almost raw. notnstirnfrô', 'review_id': 281986968, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214}
2025-03-03 01:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19745214&page=1>
{'review': 'veg Manchurian bowl too too salty. <br/>fritters/veg balls only flour, no veg.<br/>veg in the noodles v hard.  cabbage strips, carrot and onions too thick, hard almost raw. notnstirnfrô', 'review_id': 281986968, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214}
2025-03-03 01:00:34 [reviews] INFO: Scraped item: {'review': 'sent me the wrong item. ', 'review_id': 281238519, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214}
2025-03-03 01:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19745214&page=1>
{'review': 'sent me the wrong item. ', 'review_id': 281238519, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214}
2025-03-03 01:00:34 [reviews] INFO: Scraped item: {'review': 'Very good as usual .. chicken pieces were little scarce... but still good', 'review_id': 280860227, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214}
2025-03-03 01:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19745214&page=1>
{'review': 'Very good as usual .. chicken pieces were little scarce... but still good', 'review_id': 280860227, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214}
2025-03-03 01:00:34 [reviews] INFO: Scraped item: {'review': 'Manchurian Potato was extremely salty! We had to throw it out with a heavy heart', 'review_id': 280651118, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214}
2025-03-03 01:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19745214&page=1>
{'review': 'Manchurian Potato was extremely salty! We had to throw it out with a heavy heart', 'review_id': 280651118, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214}
2025-03-03 01:00:37 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19709667&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:00:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19646158&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:00:44 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19644926&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:00:48 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19559682&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:00:52 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19562464&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:00:56 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531051&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:01:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531041&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:01:04 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19470793&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:01:06 [scrapy.extensions.logstats] INFO: Crawled 129 pages (at 1 pages/min), scraped 444 items (at 5 items/min)
2025-03-03 01:01:08 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19542894&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:01:12 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19512567&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:01:16 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19494939&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:01:19 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19497084&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:01:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19645023&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:01:28 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19570166&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:01:32 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530561&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19769266&page=1> (referer: None)
2025-03-03 01:01:37 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 3, 'brand_name': 'Art Of Dum', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 19769266, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963634, 'download_latency': 1.754359245300293, 'depth': 0}
2025-03-03 01:01:37 [reviews] INFO: Scraped item: {'review': 'Had ordered two full 900 grams earlier the raita bottle and curry bottle use to come in big size', 'review_id': 281228910, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 3, 'brand_name': 'Art Of Dum', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 19769266}
2025-03-03 01:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19769266&page=1>
{'review': 'Had ordered two full 900 grams earlier the raita bottle and curry bottle use to come in big size', 'review_id': 281228910, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 3, 'brand_name': 'Art Of Dum', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 19769266}
2025-03-03 01:01:37 [reviews] INFO: Scraped item: {'review': 'Excellent food as always! Mr Vinod was very kind and courteous when i called  and everything was prepared accordingly, as we wanted the food less spicy. Excellent packaging, wonderful presentation and taste wise very  very good.', 'review_id': 281181090, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 3, 'brand_name': 'Art Of Dum', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 19769266}
2025-03-03 01:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19769266&page=1>
{'review': 'Excellent food as always! Mr Vinod was very kind and courteous when i called  and everything was prepared accordingly, as we wanted the food less spicy. Excellent packaging, wonderful presentation and taste wise very  very good.', 'review_id': 281181090, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 3, 'brand_name': 'Art Of Dum', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 19769266}
2025-03-03 01:01:37 [reviews] INFO: Scraped item: {'review': '', 'review_id': 280534787, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 3, 'brand_name': 'Art Of Dum', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 19769266}
2025-03-03 01:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19769266&page=1>
{'review': '', 'review_id': 280534787, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 3, 'brand_name': 'Art Of Dum', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 19769266}
2025-03-03 01:01:37 [reviews] INFO: Scraped item: {'review': 'Loved the wholesale packaging and the flavour full biryani. Totally worth it...😀', 'review_id': 280484966, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 3, 'brand_name': 'Art Of Dum', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 19769266}
2025-03-03 01:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19769266&page=1>
{'review': 'Loved the wholesale packaging and the flavour full biryani. Totally worth it...😀', 'review_id': 280484966, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 3, 'brand_name': 'Art Of Dum', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 19769266}
2025-03-03 01:01:37 [reviews] INFO: Scraped item: {'review': '', 'review_id': 280217027, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 3, 'brand_name': 'Art Of Dum', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 19769266}
2025-03-03 01:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19769266&page=1>
{'review': '', 'review_id': 280217027, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 3, 'brand_name': 'Art Of Dum', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 19769266}
2025-03-03 01:01:38 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19745214&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:01:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19709667&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:01:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19646158&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:01:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19644926&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:01:53 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19562464&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:01:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19559682&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:02:02 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531041&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:02:06 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531051&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:02:06 [scrapy.extensions.logstats] INFO: Crawled 130 pages (at 1 pages/min), scraped 449 items (at 5 items/min)
2025-03-03 01:02:09 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19542894&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19832717&page=1> (referer: None)
2025-03-03 01:02:13 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963673, 'download_latency': 0.707442045211792, 'depth': 0}
2025-03-03 01:02:13 [reviews] INFO: Scraped item: {'review': 'staff & service was good and fast. ', 'review_id': 282268602, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717}
2025-03-03 01:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19832717&page=1>
{'review': 'staff & service was good and fast. ', 'review_id': 282268602, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717}
2025-03-03 01:02:13 [reviews] INFO: Scraped item: {'review': 'very spicy 🔥', 'review_id': 282121291, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717}
2025-03-03 01:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19832717&page=1>
{'review': 'very spicy 🔥', 'review_id': 282121291, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717}
2025-03-03 01:02:13 [reviews] INFO: Scraped item: {'review': '', 'review_id': 280524160, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717}
2025-03-03 01:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19832717&page=1>
{'review': '', 'review_id': 280524160, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717}
2025-03-03 01:02:13 [reviews] INFO: Scraped item: {'review': 'it took over 45 min for the order', 'review_id': 280258486, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717}
2025-03-03 01:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19832717&page=1>
{'review': 'it took over 45 min for the order', 'review_id': 280258486, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717}
2025-03-03 01:02:13 [reviews] INFO: Scraped item: {'review': 'food was almost cold.  food was taste less. very disappointing with taste. road side chinese taste better.  did not deserved star too.', 'review_id': 280230928, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717}
2025-03-03 01:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19832717&page=1>
{'review': 'food was almost cold.  food was taste less. very disappointing with taste. road side chinese taste better.  did not deserved star too.', 'review_id': 280230928, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717}
2025-03-03 01:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19845961&page=1> (referer: None)
2025-03-03 01:02:16 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19845961, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963677, 'download_latency': 0.7155675888061523, 'depth': 0}
2025-03-03 01:02:16 [reviews] INFO: Scraped item: {'review': 'qty is less', 'review_id': 282141090, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19845961}
2025-03-03 01:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19845961&page=1>
{'review': 'qty is less', 'review_id': 282141090, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19845961}
2025-03-03 01:02:16 [reviews] INFO: Scraped item: {'review': 'taste and quality of rice deteriorated so much in 1 year....niyaz brand is better than this', 'review_id': 282139991, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19845961}
2025-03-03 01:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19845961&page=1>
{'review': 'taste and quality of rice deteriorated so much in 1 year....niyaz brand is better than this', 'review_id': 282139991, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19845961}
2025-03-03 01:02:16 [reviews] INFO: Scraped item: {'review': 'quantity and taste was very low', 'review_id': 282074278, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19845961}
2025-03-03 01:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19845961&page=1>
{'review': 'quantity and taste was very low', 'review_id': 282074278, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19845961}
2025-03-03 01:02:16 [reviews] INFO: Scraped item: {'review': 'Biryani by kilo is always the best biryani. but today it was just reversed. biryani was not of same taste, it was very dry and full of dry rice. hardly any species. Same was the case for chicken and mutton both. ', 'review_id': 281608505, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19845961}
2025-03-03 01:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19845961&page=1>
{'review': 'Biryani by kilo is always the best biryani. but today it was just reversed. biryani was not of same taste, it was very dry and full of dry rice. hardly any species. Same was the case for chicken and mutton both. ', 'review_id': 281608505, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19845961}
2025-03-03 01:02:16 [reviews] INFO: Scraped item: {'review': "I love your biryani it's always tasty and lovely we love to eat ", 'review_id': 281388822, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19845961}
2025-03-03 01:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19845961&page=1>
{'review': "I love your biryani it's always tasty and lovely we love to eat ", 'review_id': 281388822, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19845961}
2025-03-03 01:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19855416&page=1> (referer: None)
2025-03-03 01:02:21 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'MumbaiMumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 19855416, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963680, 'download_latency': 0.78883957862854, 'depth': 0}
2025-03-03 01:02:21 [reviews] INFO: Scraped item: {'review': 'food was cold and barely edible ', 'review_id': 281003716, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'MumbaiMumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 19855416}
2025-03-03 01:02:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19855416&page=1>
{'review': 'food was cold and barely edible ', 'review_id': 281003716, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'MumbaiMumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 19855416}
2025-03-03 01:02:21 [reviews] INFO: Scraped item: {'review': 'food was cold ...reallyndry ', 'review_id': 280547310, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'MumbaiMumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 19855416}
2025-03-03 01:02:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19855416&page=1>
{'review': 'food was cold ...reallyndry ', 'review_id': 280547310, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'MumbaiMumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 19855416}
2025-03-03 01:02:21 [reviews] INFO: Stopping for res_id: 19855416 as reviews are older than 7 days.
2025-03-03 01:02:23 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19645023&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:02:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19570166&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19856363&page=1> (referer: None)
2025-03-03 01:02:32 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963693, 'download_latency': 0.7314517498016357, 'depth': 0}
2025-03-03 01:02:32 [reviews] INFO: Scraped item: {'review': 'Food is cold', 'review_id': 282224239, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363}
2025-03-03 01:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19856363&page=1>
{'review': 'Food is cold', 'review_id': 282224239, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363}
2025-03-03 01:02:32 [reviews] INFO: Scraped item: {'review': 'Taste in point.', 'review_id': 282104519, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363}
2025-03-03 01:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19856363&page=1>
{'review': 'Taste in point.', 'review_id': 282104519, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363}
2025-03-03 01:02:32 [reviews] INFO: Scraped item: {'review': 'Too much salt added to hunan paneer dry, and burnt garlic noodles is ok.', 'review_id': 282067648, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363}
2025-03-03 01:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19856363&page=1>
{'review': 'Too much salt added to hunan paneer dry, and burnt garlic noodles is ok.', 'review_id': 282067648, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363}
2025-03-03 01:02:32 [reviews] INFO: Scraped item: {'review': 'making fool', 'review_id': 281831582, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363}
2025-03-03 01:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19856363&page=1>
{'review': 'making fool', 'review_id': 281831582, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363}
2025-03-03 01:02:32 [reviews] INFO: Scraped item: {'review': 'Too authentic and flavourful', 'review_id': 281821328, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363}
2025-03-03 01:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19856363&page=1>
{'review': 'Too authentic and flavourful', 'review_id': 281821328, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363}
2025-03-03 01:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19894306&page=1> (referer: None)
2025-03-03 01:02:33 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963697, 'download_latency': 0.7896003723144531, 'depth': 0}
2025-03-03 01:02:33 [reviews] INFO: Scraped item: {'review': 'It was a bit oily, rest is good', 'review_id': 282233417, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306}
2025-03-03 01:02:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19894306&page=1>
{'review': 'It was a bit oily, rest is good', 'review_id': 282233417, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306}
2025-03-03 01:02:33 [reviews] INFO: Scraped item: {'review': 'I have added a note saying that the food should be less spicy, but i got opposite... food was more spicy than usual.', 'review_id': 282231773, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306}
2025-03-03 01:02:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19894306&page=1>
{'review': 'I have added a note saying that the food should be less spicy, but i got opposite... food was more spicy than usual.', 'review_id': 282231773, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306}
2025-03-03 01:02:33 [reviews] INFO: Scraped item: {'review': 'This is not what i had ordered I ordered veg biryani bowl 500g this is far less', 'review_id': 282209961, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306}
2025-03-03 01:02:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19894306&page=1>
{'review': 'This is not what i had ordered I ordered veg biryani bowl 500g this is far less', 'review_id': 282209961, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306}
2025-03-03 01:02:33 [reviews] INFO: Scraped item: {'review': 'Too spicy', 'review_id': 282101628, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306}
2025-03-03 01:02:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19894306&page=1>
{'review': 'Too spicy', 'review_id': 282101628, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306}
2025-03-03 01:02:33 [reviews] INFO: Scraped item: {'review': 'amazing 😍', 'review_id': 282054959, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306}
2025-03-03 01:02:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19894306&page=1>
{'review': 'amazing 😍', 'review_id': 282054959, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306}
2025-03-03 01:02:37 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19769266&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:02:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19745214&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:02:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19709667&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:02:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19646158&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:02:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19644926&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:02:57 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19559682&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:03:02 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19562464&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19931697&page=1> (referer: None)
2025-03-03 01:03:06 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963726, 'download_latency': 0.8149459362030029, 'depth': 0}
2025-03-03 01:03:06 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281803345, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697}
2025-03-03 01:03:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19931697&page=1>
{'review': '', 'review_id': 281803345, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697}
2025-03-03 01:03:06 [reviews] INFO: Scraped item: {'review': 'yummy yummy yummy ', 'review_id': 281734168, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697}
2025-03-03 01:03:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19931697&page=1>
{'review': 'yummy yummy yummy ', 'review_id': 281734168, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697}
2025-03-03 01:03:06 [reviews] INFO: Scraped item: {'review': 'The gajar halwa was tasting stale and it had a lump of mawa in it', 'review_id': 280448982, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697}
2025-03-03 01:03:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19931697&page=1>
{'review': 'The gajar halwa was tasting stale and it had a lump of mawa in it', 'review_id': 280448982, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697}
2025-03-03 01:03:06 [reviews] INFO: Stopping for res_id: 19931697 as reviews are older than 7 days.
2025-03-03 01:03:06 [scrapy.extensions.logstats] INFO: Crawled 136 pages (at 6 pages/min), scraped 474 items (at 25 items/min)
2025-03-03 01:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20020341&page=1> (referer: None)
2025-03-03 01:03:09 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963729, 'download_latency': 0.792304277420044, 'depth': 0}
2025-03-03 01:03:09 [reviews] INFO: Scraped item: {'review': 'ok ok taste', 'review_id': 282220804, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341}
2025-03-03 01:03:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20020341&page=1>
{'review': 'ok ok taste', 'review_id': 282220804, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341}
2025-03-03 01:03:09 [reviews] INFO: Scraped item: {'review': 'Biryani was completely burnt out from the bottom and that was tasteless and even raita was leaked out from the packet. Worst biryani', 'review_id': 281466154, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341}
2025-03-03 01:03:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20020341&page=1>
{'review': 'Biryani was completely burnt out from the bottom and that was tasteless and even raita was leaked out from the packet. Worst biryani', 'review_id': 281466154, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341}
2025-03-03 01:03:09 [reviews] INFO: Scraped item: {'review': 'this is just over priced garbage they are selling matka for 500₹ 👎👎😡', 'review_id': 281430016, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341}
2025-03-03 01:03:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20020341&page=1>
{'review': 'this is just over priced garbage they are selling matka for 500₹ 👎👎😡', 'review_id': 281430016, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341}
2025-03-03 01:03:09 [reviews] INFO: Scraped item: {'review': "Very nice it's fabulous", 'review_id': 281107836, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341}
2025-03-03 01:03:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20020341&page=1>
{'review': "Very nice it's fabulous", 'review_id': 281107836, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341}
2025-03-03 01:03:09 [reviews] INFO: Scraped item: {'review': 'The raita sent was all spilt ', 'review_id': 280628803, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341}
2025-03-03 01:03:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20020341&page=1>
{'review': 'The raita sent was all spilt ', 'review_id': 280628803, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341}
2025-03-03 01:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20086621&page=1> (referer: None)
2025-03-03 01:03:13 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 36, 'brand_name': 'Slay Coffee Bar', 'city': 'Bangalore', 'sub_zone': 'RMZ Millenia', 'platform': 'zomato', 'res_id': 20086621, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963734, 'download_latency': 0.7204828262329102, 'depth': 0}
2025-03-03 01:03:13 [reviews] INFO: Stopping for res_id: 20086621 as reviews are older than 7 days.
2025-03-03 01:03:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19832717&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:03:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19845961&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:03:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19645023&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:03:25 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19570166&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20214336&page=1> (referer: None)
2025-03-03 01:03:30 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 26, 'brand_name': 'Starbucks Coffee', 'city': 'Bangalore', 'sub_zone': 'Garuda Mall', 'platform': 'zomato', 'res_id': 20214336, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963752, 'download_latency': 0.721592903137207, 'depth': 0}
2025-03-03 01:03:30 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281801086, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 26, 'brand_name': 'Starbucks Coffee', 'city': 'Bangalore', 'sub_zone': 'Garuda Mall', 'platform': 'zomato', 'res_id': 20214336}
2025-03-03 01:03:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20214336&page=1>
{'review': '', 'review_id': 281801086, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 26, 'brand_name': 'Starbucks Coffee', 'city': 'Bangalore', 'sub_zone': 'Garuda Mall', 'platform': 'zomato', 'res_id': 20214336}
2025-03-03 01:03:30 [reviews] INFO: Stopping for res_id: 20214336 as reviews are older than 7 days.
2025-03-03 01:03:33 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19856363&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:03:37 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19894306&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:03:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19769266&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:03:44 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19745214&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:03:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19709667&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:03:52 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19646158&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:03:55 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19644926&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20227195&page=1> (referer: None)
2025-03-03 01:04:00 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 20227195, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963782, 'download_latency': 1.8662505149841309, 'depth': 0}
2025-03-03 01:04:00 [reviews] INFO: Scraped item: {'review': 'No mutton pieces', 'review_id': 282213446, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 20227195}
2025-03-03 01:04:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20227195&page=1>
{'review': 'No mutton pieces', 'review_id': 282213446, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 20227195}
2025-03-03 01:04:00 [reviews] INFO: Scraped item: {'review': '', 'review_id': 282210578, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 20227195}
2025-03-03 01:04:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20227195&page=1>
{'review': '', 'review_id': 282210578, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 20227195}
2025-03-03 01:04:00 [reviews] INFO: Scraped item: {'review': "For the first i hated this briyani i can't chew paneer  as well as there was only rice no masala at all", 'review_id': 281976798, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 20227195}
2025-03-03 01:04:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20227195&page=1>
{'review': "For the first i hated this briyani i can't chew paneer  as well as there was only rice no masala at all", 'review_id': 281976798, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 20227195}
2025-03-03 01:04:00 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281780743, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 20227195}
2025-03-03 01:04:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20227195&page=1>
{'review': '', 'review_id': 281780743, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 20227195}
2025-03-03 01:04:00 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281424006, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 20227195}
2025-03-03 01:04:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20227195&page=1>
{'review': '', 'review_id': 281424006, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 20227195}
2025-03-03 01:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20248171&page=1> (referer: None)
2025-03-03 01:04:03 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Vikhroli', 'platform': 'zomato', 'res_id': 20248171, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963786, 'download_latency': 0.9130291938781738, 'depth': 0}
2025-03-03 01:04:03 [reviews] ERROR: Unrecognized relative_date format: aug 27, 2023
2025-03-03 01:04:03 [reviews] INFO: Stopping for res_id: 20248171 due to unrecognized date format: Aug 27, 2023.
2025-03-03 01:04:06 [scrapy.extensions.logstats] INFO: Crawled 141 pages (at 5 pages/min), scraped 485 items (at 11 items/min)
2025-03-03 01:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20265082&page=1> (referer: None)
2025-03-03 01:04:07 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 32, 'brand_name': 'Third Wave Coffee', 'city': 'Bangalore', 'sub_zone': 'Lavelle Road', 'platform': 'zomato', 'res_id': 20265082, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963790, 'download_latency': 0.8676333427429199, 'depth': 0}
2025-03-03 01:04:07 [reviews] INFO: Scraped item: {'review': 'awesome packing loved it', 'review_id': 280405807, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 32, 'brand_name': 'Third Wave Coffee', 'city': 'Bangalore', 'sub_zone': 'Lavelle Road', 'platform': 'zomato', 'res_id': 20265082}
2025-03-03 01:04:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20265082&page=1>
{'review': 'awesome packing loved it', 'review_id': 280405807, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 32, 'brand_name': 'Third Wave Coffee', 'city': 'Bangalore', 'sub_zone': 'Lavelle Road', 'platform': 'zomato', 'res_id': 20265082}
2025-03-03 01:04:07 [reviews] INFO: Stopping for res_id: 20265082 as reviews are older than 7 days.
2025-03-03 01:04:10 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20020341&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:04:15 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19832717&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:04:19 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19845961&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:04:23 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19645023&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20267173&page=1> (referer: None)
2025-03-03 01:04:26 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 20267173, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963806, 'download_latency': 0.7368371486663818, 'depth': 0}
2025-03-03 01:04:26 [reviews] INFO: Scraped item: {'review': 'Too much oil and smelling', 'review_id': 281799084, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 20267173}
2025-03-03 01:04:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20267173&page=1>
{'review': 'Too much oil and smelling', 'review_id': 281799084, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 20267173}
2025-03-03 01:04:26 [reviews] INFO: Scraped item: {'review': 'was superb', 'review_id': 281788281, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 20267173}
2025-03-03 01:04:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20267173&page=1>
{'review': 'was superb', 'review_id': 281788281, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 20267173}
2025-03-03 01:04:26 [reviews] INFO: Scraped item: {'review': 'I ordered chicken fried rice the ricw was burned amd sent the whole rice tasted burned, the egg and chicken in it is charred as seen in the pictureb. Horrible in taste. Veey disappointed by this for the price i expected better ', 'review_id': 281755770, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 20267173}
2025-03-03 01:04:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20267173&page=1>
{'review': 'I ordered chicken fried rice the ricw was burned amd sent the whole rice tasted burned, the egg and chicken in it is charred as seen in the pictureb. Horrible in taste. Veey disappointed by this for the price i expected better ', 'review_id': 281755770, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 20267173}
2025-03-03 01:04:26 [reviews] INFO: Scraped item: {'review': 'great service by mittu, Thai chicken 4/5 Mongolian pot rice 4/5 because no shiitake mushrooms', 'review_id': 281458935, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-01', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 20267173}
2025-03-03 01:04:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20267173&page=1>
{'review': 'great service by mittu, Thai chicken 4/5 Mongolian pot rice 4/5 because no shiitake mushrooms', 'review_id': 281458935, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-01', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 20267173}
2025-03-03 01:04:26 [reviews] INFO: Scraped item: {'review': 'dead cockroach in my food', 'review_id': 281446841, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 20267173}
2025-03-03 01:04:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20267173&page=1>
{'review': 'dead cockroach in my food', 'review_id': 281446841, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 20267173}
2025-03-03 01:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20284206&page=1> (referer: None)
2025-03-03 01:04:29 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'FUNREPUBLIC MALL', 'platform': 'zomato', 'res_id': 20284206, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963811, 'download_latency': 0.6734516620635986, 'depth': 0}
2025-03-03 01:04:29 [reviews] INFO: Scraped item: {'review': 'Uttpal Ghosh served us very well. Food was also good we really enjoyed.', 'review_id': 282172838, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'FUNREPUBLIC MALL', 'platform': 'zomato', 'res_id': 20284206}
2025-03-03 01:04:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20284206&page=1>
{'review': 'Uttpal Ghosh served us very well. Food was also good we really enjoyed.', 'review_id': 282172838, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'FUNREPUBLIC MALL', 'platform': 'zomato', 'res_id': 20284206}
2025-03-03 01:04:29 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281851787, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'FUNREPUBLIC MALL', 'platform': 'zomato', 'res_id': 20284206}
2025-03-03 01:04:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20284206&page=1>
{'review': '', 'review_id': 281851787, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'FUNREPUBLIC MALL', 'platform': 'zomato', 'res_id': 20284206}
2025-03-03 01:04:29 [reviews] INFO: Scraped item: {'review': 'Good food and good people. Thanks Nehal.', 'review_id': 281767699, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'FUNREPUBLIC MALL', 'platform': 'zomato', 'res_id': 20284206}
2025-03-03 01:04:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20284206&page=1>
{'review': 'Good food and good people. Thanks Nehal.', 'review_id': 281767699, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'FUNREPUBLIC MALL', 'platform': 'zomato', 'res_id': 20284206}
2025-03-03 01:04:29 [reviews] INFO: Scraped item: {'review': 'Loved the experience. Thank you Vikash Sharma for the hospitality', 'review_id': 281756066, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'FUNREPUBLIC MALL', 'platform': 'zomato', 'res_id': 20284206}
2025-03-03 01:04:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20284206&page=1>
{'review': 'Loved the experience. Thank you Vikash Sharma for the hospitality', 'review_id': 281756066, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'FUNREPUBLIC MALL', 'platform': 'zomato', 'res_id': 20284206}
2025-03-03 01:04:29 [reviews] INFO: Scraped item: {'review': 'Really nice food and service', 'review_id': 281701555, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'FUNREPUBLIC MALL', 'platform': 'zomato', 'res_id': 20284206}
2025-03-03 01:04:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20284206&page=1>
{'review': 'Really nice food and service', 'review_id': 281701555, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'FUNREPUBLIC MALL', 'platform': 'zomato', 'res_id': 20284206}
2025-03-03 01:04:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19856363&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:04:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19894306&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:04:39 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19769266&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:04:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19745214&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:04:45 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19709667&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:04:48 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19646158&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20340568&page=1> (referer: None)
2025-03-03 01:04:52 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Palladium Mall (Lower Parel)', 'platform': 'zomato', 'res_id': 20340568, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963835, 'download_latency': 0.7243828773498535, 'depth': 0}
2025-03-03 01:04:52 [reviews] INFO: Stopping for res_id: 20340568 as reviews are older than 7 days.
2025-03-03 01:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20358424&page=1> (referer: None)
2025-03-03 01:04:55 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963840, 'download_latency': 0.8121905326843262, 'depth': 0}
2025-03-03 01:04:55 [reviews] INFO: Scraped item: {'review': 'Awesome food', 'review_id': 281304396, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424}
2025-03-03 01:04:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20358424&page=1>
{'review': 'Awesome food', 'review_id': 281304396, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424}
2025-03-03 01:04:55 [reviews] INFO: Scraped item: {'review': 'The kebab delivered was cold and hard.. No chutney and onion served alongwith kabab. It was very unpleasant to eat. highly disappointed. not worth the money.', 'review_id': 281190006, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424}
2025-03-03 01:04:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20358424&page=1>
{'review': 'The kebab delivered was cold and hard.. No chutney and onion served alongwith kabab. It was very unpleasant to eat. highly disappointed. not worth the money.', 'review_id': 281190006, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424}
2025-03-03 01:04:55 [reviews] INFO: Scraped item: {'review': 'awesome ', 'review_id': 280780033, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424}
2025-03-03 01:04:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20358424&page=1>
{'review': 'awesome ', 'review_id': 280780033, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424}
2025-03-03 01:04:55 [reviews] INFO: Scraped item: {'review': 'Awesome taste', 'review_id': 280625972, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424}
2025-03-03 01:04:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20358424&page=1>
{'review': 'Awesome taste', 'review_id': 280625972, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424}
2025-03-03 01:04:55 [reviews] INFO: Stopping for res_id: 20358424 as reviews are older than 7 days.
2025-03-03 01:04:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20227195&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20388081&page=1> (referer: None)
2025-03-03 01:05:02 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963847, 'download_latency': 0.7751493453979492, 'depth': 0}
2025-03-03 01:05:02 [reviews] INFO: Scraped item: {'review': 'The dishes were not fresh', 'review_id': 281696301, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081}
2025-03-03 01:05:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20388081&page=1>
{'review': 'The dishes were not fresh', 'review_id': 281696301, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081}
2025-03-03 01:05:02 [reviews] INFO: Scraped item: {'review': 'it was not at all crispy....bad taste...<br/><br/>', 'review_id': 281329007, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081}
2025-03-03 01:05:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20388081&page=1>
{'review': 'it was not at all crispy....bad taste...<br/><br/>', 'review_id': 281329007, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081}
2025-03-03 01:05:02 [reviews] INFO: Scraped item: {'review': 'Mohits service was excellent', 'review_id': 280510813, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-02-26', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081}
2025-03-03 01:05:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20388081&page=1>
{'review': 'Mohits service was excellent', 'review_id': 280510813, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-02-26', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081}
2025-03-03 01:05:02 [reviews] INFO: Scraped item: {'review': 'Mohit was curteous and good with his demeanour<br/>', 'review_id': 280503249, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-02-26', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081}
2025-03-03 01:05:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20388081&page=1>
{'review': 'Mohit was curteous and good with his demeanour<br/>', 'review_id': 280503249, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-02-26', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081}
2025-03-03 01:05:02 [reviews] INFO: Scraped item: {'review': 'Amazing food and also the service and  recommendations was good by Mohit  ,', 'review_id': 280306285, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-02-25', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081}
2025-03-03 01:05:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20388081&page=1>
{'review': 'Amazing food and also the service and  recommendations was good by Mohit  ,', 'review_id': 280306285, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-02-25', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081}
2025-03-03 01:05:05 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20020341&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2025-03-03 01:05:06 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108
2025-03-03 01:05:06 [scrapy.extensions.logstats] INFO: Crawled 147 pages (at 6 pages/min), scraped 505 items (at 20 items/min)
2025-03-03 01:05:10 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19832717&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:05:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19845961&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20420004&page=1> (referer: None)
2025-03-03 01:05:19 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 20420004, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963863, 'download_latency': 0.7219960689544678, 'depth': 0}
2025-03-03 01:05:19 [reviews] INFO: Scraped item: {'review': "The star of the show 'Mutton' was undercooked which spoiled the mood of the food ", 'review_id': 282202218, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 20420004}
2025-03-03 01:05:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20420004&page=1>
{'review': "The star of the show 'Mutton' was undercooked which spoiled the mood of the food ", 'review_id': 282202218, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 20420004}
2025-03-03 01:05:19 [reviews] INFO: Scraped item: {'review': 'Very good test', 'review_id': 282179336, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 20420004}
2025-03-03 01:05:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20420004&page=1>
{'review': 'Very good test', 'review_id': 282179336, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 20420004}
2025-03-03 01:05:19 [reviews] INFO: Scraped item: {'review': "we like you'r biryani very much and specially we recommend our friends and family members to try their hyderabadi chicken 65 biryani", 'review_id': 282158087, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 20420004}
2025-03-03 01:05:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20420004&page=1>
{'review': "we like you'r biryani very much and specially we recommend our friends and family members to try their hyderabadi chicken 65 biryani", 'review_id': 282158087, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 20420004}
2025-03-03 01:05:19 [reviews] INFO: Scraped item: {'review': 'Egg missing', 'review_id': 281740075, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 20420004}
2025-03-03 01:05:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20420004&page=1>
{'review': 'Egg missing', 'review_id': 281740075, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 20420004}
2025-03-03 01:05:19 [reviews] INFO: Scraped item: {'review': 'delicious 😋', 'review_id': 281626724, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 20420004}
2025-03-03 01:05:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20420004&page=1>
{'review': 'delicious 😋', 'review_id': 281626724, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 20420004}
2025-03-03 01:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20420093&page=1> (referer: None)
2025-03-03 01:05:22 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 31, 'brand_name': 'Twenty Seven Bake House', 'city': 'Mumbai', 'sub_zone': 'Mahalaxmi', 'platform': 'zomato', 'res_id': 20420093, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963866, 'download_latency': 0.7420487403869629, 'depth': 0}
2025-03-03 01:05:22 [reviews] INFO: Stopping for res_id: 20420093 as reviews are older than 7 days.
2025-03-03 01:05:23 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20267173&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:05:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20284206&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:05:31 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19894306&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:05:35 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19856363&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:05:38 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19769266&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:05:43 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19745214&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:05:46 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19709667&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20440117&page=1> (referer: None)
2025-03-03 01:05:51 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963892, 'download_latency': 0.7448408603668213, 'depth': 0}
2025-03-03 01:05:51 [reviews] INFO: Scraped item: {'review': 'even after saying not to make it spicy they made it spicky.. the taste is like it is made 4-5 hours ago.. and after specially mentioning also they sent spicy shezwan sauce instead of ketchup.. ', 'review_id': 281650888, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117}
2025-03-03 01:05:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20440117&page=1>
{'review': 'even after saying not to make it spicy they made it spicky.. the taste is like it is made 4-5 hours ago.. and after specially mentioning also they sent spicy shezwan sauce instead of ketchup.. ', 'review_id': 281650888, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117}
2025-03-03 01:05:51 [reviews] INFO: Scraped item: {'review': 'Wrong food, high price, ', 'review_id': 281229250, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117}
2025-03-03 01:05:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20440117&page=1>
{'review': 'Wrong food, high price, ', 'review_id': 281229250, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117}
2025-03-03 01:05:51 [reviews] INFO: Scraped item: {'review': 'the order was extremely late. ', 'review_id': 280656748, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117}
2025-03-03 01:05:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20440117&page=1>
{'review': 'the order was extremely late. ', 'review_id': 280656748, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117}
2025-03-03 01:05:51 [reviews] INFO: Scraped item: {'review': '', 'review_id': 280602579, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117}
2025-03-03 01:05:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20440117&page=1>
{'review': '', 'review_id': 280602579, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117}
2025-03-03 01:05:51 [reviews] INFO: Stopping for res_id: 20440117 as reviews are older than 7 days.
2025-03-03 01:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20448735&page=1> (referer: None)
2025-03-03 01:05:55 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20448735, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963895, 'download_latency': 0.767179012298584, 'depth': 0}
2025-03-03 01:05:55 [reviews] INFO: Scraped item: {'review': 'My order was tempered with by the delivery partner , all food items goof spilled . The bag was torn and banana pudding missing. Horrible experience  to further rub salt on my wounds the customer care executives transferred me back to Zia bot for issue resolution . Horrible , distasteful and disgraceful', 'review_id': 280381136, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20448735}
2025-03-03 01:05:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20448735&page=1>
{'review': 'My order was tempered with by the delivery partner , all food items goof spilled . The bag was torn and banana pudding missing. Horrible experience  to further rub salt on my wounds the customer care executives transferred me back to Zia bot for issue resolution . Horrible , distasteful and disgraceful', 'review_id': 280381136, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20448735}
2025-03-03 01:05:55 [reviews] INFO: Stopping for res_id: 20448735 as reviews are older than 7 days.
2025-03-03 01:05:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20227195&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:06:06 [scrapy.extensions.logstats] INFO: Crawled 151 pages (at 4 pages/min), scraped 515 items (at 10 items/min)
2025-03-03 01:06:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20388081&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20509246&page=1> (referer: None)
2025-03-03 01:06:08 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 32, 'brand_name': 'Third Wave Coffee', 'city': 'Mumbai', 'sub_zone': 'Colaba', 'platform': 'zomato', 'res_id': 20509246, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963902, 'download_latency': 5.261508464813232, 'depth': 0}
2025-03-03 01:06:08 [reviews] INFO: Stopping for res_id: 20509246 as reviews are older than 7 days.
2025-03-03 01:06:11 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20020341&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:06:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19845961&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:06:17 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19832717&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:06:21 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20420004&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:06:25 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20267173&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:06:28 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20284206&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:06:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19894306&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:06:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19856363&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:06:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19769266&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:06:45 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19745214&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20516112&page=1> (referer: None)
2025-03-03 01:06:50 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963946, 'download_latency': 1.0782506465911865, 'depth': 0}
2025-03-03 01:06:50 [reviews] INFO: Scraped item: {'review': 'Everything is superb <br/><br/>But price felt a bit over', 'review_id': 282245465, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112}
2025-03-03 01:06:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20516112&page=1>
{'review': 'Everything is superb <br/><br/>But price felt a bit over', 'review_id': 282245465, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112}
2025-03-03 01:06:50 [reviews] INFO: Scraped item: {'review': '', 'review_id': 282143824, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112}
2025-03-03 01:06:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20516112&page=1>
{'review': '', 'review_id': 282143824, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112}
2025-03-03 01:06:50 [reviews] INFO: Scraped item: {'review': "I ordered kabsa biriyani but it was more like tandoori biryani.<br/>Also I ordered full biriyani but I didn't get one single leg 🍗 it was only the ribs part. I heard so much about the restaurant and ordered it. ", 'review_id': 282085872, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112}
2025-03-03 01:06:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20516112&page=1>
{'review': "I ordered kabsa biriyani but it was more like tandoori biryani.<br/>Also I ordered full biriyani but I didn't get one single leg 🍗 it was only the ribs part. I heard so much about the restaurant and ordered it. ", 'review_id': 282085872, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112}
2025-03-03 01:06:50 [reviews] INFO: Scraped item: {'review': 'Food is absolutely best. The service and ambience are worth the money. ', 'review_id': 282051238, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112}
2025-03-03 01:06:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20516112&page=1>
{'review': 'Food is absolutely best. The service and ambience are worth the money. ', 'review_id': 282051238, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112}
2025-03-03 01:06:50 [reviews] INFO: Scraped item: {'review': '', 'review_id': 282028704, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112}
2025-03-03 01:06:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20516112&page=1>
{'review': '', 'review_id': 282028704, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112}
2025-03-03 01:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517056&page=1> (referer: None)
2025-03-03 01:06:54 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 35, 'brand_name': 'True Black Specialty Coffee', 'city': 'Hyderabad ', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20517056, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963951, 'download_latency': 1.6039471626281738, 'depth': 0}
2025-03-03 01:06:54 [reviews] INFO: Scraped item: {'review': 'One of the best chicken sandwiches for delivery! Just too good. Please maintain the standards!!!', 'review_id': 282099023, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 35, 'brand_name': 'True Black Specialty Coffee', 'city': 'Hyderabad ', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20517056}
2025-03-03 01:06:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517056&page=1>
{'review': 'One of the best chicken sandwiches for delivery! Just too good. Please maintain the standards!!!', 'review_id': 282099023, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 35, 'brand_name': 'True Black Specialty Coffee', 'city': 'Hyderabad ', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20517056}
2025-03-03 01:06:54 [reviews] INFO: Scraped item: {'review': 'Why is your packaging glass not as sturdy as what Starbucks uses. This is the second time that my hot coffee has leaked out from the bottom of the glass. Please try to test your containers properly before putting them to use for the customers ', 'review_id': 281795455, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 35, 'brand_name': 'True Black Specialty Coffee', 'city': 'Hyderabad ', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20517056}
2025-03-03 01:06:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517056&page=1>
{'review': 'Why is your packaging glass not as sturdy as what Starbucks uses. This is the second time that my hot coffee has leaked out from the bottom of the glass. Please try to test your containers properly before putting them to use for the customers ', 'review_id': 281795455, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 35, 'brand_name': 'True Black Specialty Coffee', 'city': 'Hyderabad ', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20517056}
2025-03-03 01:06:54 [reviews] INFO: Scraped item: {'review': 'Not one time coffee got cold', 'review_id': 281190867, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 35, 'brand_name': 'True Black Specialty Coffee', 'city': 'Hyderabad ', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20517056}
2025-03-03 01:06:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517056&page=1>
{'review': 'Not one time coffee got cold', 'review_id': 281190867, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 35, 'brand_name': 'True Black Specialty Coffee', 'city': 'Hyderabad ', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20517056}
2025-03-03 01:06:54 [reviews] INFO: Stopping for res_id: 20517056 as reviews are older than 7 days.
2025-03-03 01:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517146&page=1> (referer: None)
2025-03-03 01:06:56 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963955, 'download_latency': 1.1674582958221436, 'depth': 0}
2025-03-03 01:06:56 [reviews] INFO: Scraped item: {'review': 'The food was stale and smelly and zomato is not ready to take responsibility of the same. pathetic service by zomato', 'review_id': 282245420, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146}
2025-03-03 01:06:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517146&page=1>
{'review': 'The food was stale and smelly and zomato is not ready to take responsibility of the same. pathetic service by zomato', 'review_id': 282245420, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146}
2025-03-03 01:06:56 [reviews] INFO: Scraped item: {'review': 'Average food at best', 'review_id': 281464419, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146}
2025-03-03 01:06:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517146&page=1>
{'review': 'Average food at best', 'review_id': 281464419, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146}
2025-03-03 01:06:56 [reviews] INFO: Scraped item: {'review': 'vey nice food   rating. 10/10', 'review_id': 280807927, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146}
2025-03-03 01:06:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517146&page=1>
{'review': 'vey nice food   rating. 10/10', 'review_id': 280807927, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146}
2025-03-03 01:06:56 [reviews] INFO: Scraped item: {'review': '', 'review_id': 280720983, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146}
2025-03-03 01:06:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517146&page=1>
{'review': '', 'review_id': 280720983, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146}
2025-03-03 01:06:56 [reviews] INFO: Scraped item: {'review': 'Nice taste and good quantity', 'review_id': 280435274, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146}
2025-03-03 01:06:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517146&page=1>
{'review': 'Nice taste and good quantity', 'review_id': 280435274, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146}
2025-03-03 01:06:59 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20227195&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:07:01 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20388081&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:07:06 [scrapy.extensions.logstats] INFO: Crawled 155 pages (at 4 pages/min), scraped 528 items (at 13 items/min)
2025-03-03 01:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20528405&page=1> (referer: None)
2025-03-03 01:07:07 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 51, 'brand_name': 'Soba Sassy', 'city': 'Kolkata', 'sub_zone': 'Camac Street Area', 'platform': 'zomato', 'res_id': 20528405, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740963968, 'download_latency': 1.4672250747680664, 'depth': 0}
2025-03-03 01:07:07 [reviews] INFO: Scraped item: {'review': 'super place', 'review_id': 281131686, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-02-28', 'competitor_id': 51, 'brand_name': 'Soba Sassy', 'city': 'Kolkata', 'sub_zone': 'Camac Street Area', 'platform': 'zomato', 'res_id': 20528405}
2025-03-03 01:07:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20528405&page=1>
{'review': 'super place', 'review_id': 281131686, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-02-28', 'competitor_id': 51, 'brand_name': 'Soba Sassy', 'city': 'Kolkata', 'sub_zone': 'Camac Street Area', 'platform': 'zomato', 'res_id': 20528405}
2025-03-03 01:07:07 [reviews] INFO: Stopping for res_id: 20528405 as reviews are older than 7 days.
2025-03-03 01:07:10 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20020341&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:07:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19845961&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:07:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19832717&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:07:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20420004&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:07:25 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20267173&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:07:29 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20284206&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:07:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19894306&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:07:35 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19856363&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:07:37 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19769266&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20587336&page=1> (referer: None)
2025-03-03 01:07:46 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Inorbit Mall', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20587336, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964010, 'download_latency': 1.9991004467010498, 'depth': 0}
2025-03-03 01:07:46 [reviews] INFO: Scraped item: {'review': "my order is not received wear my odar<br/>this not good,I odar by12.00pm,<br/>khow it's 2.18 how can like that ", 'review_id': 281970771, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Inorbit Mall', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20587336}
2025-03-03 01:07:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20587336&page=1>
{'review': "my order is not received wear my odar<br/>this not good,I odar by12.00pm,<br/>khow it's 2.18 how can like that ", 'review_id': 281970771, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Inorbit Mall', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20587336}
2025-03-03 01:07:46 [reviews] INFO: Scraped item: {'review': 'value for money ', 'review_id': 280824401, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-02-27', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Inorbit Mall', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20587336}
2025-03-03 01:07:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20587336&page=1>
{'review': 'value for money ', 'review_id': 280824401, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-02-27', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Inorbit Mall', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20587336}
2025-03-03 01:07:46 [reviews] INFO: Scraped item: {'review': 'Good staff behaviour also good taste', 'review_id': 280821392, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-02-27', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Inorbit Mall', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20587336}
2025-03-03 01:07:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20587336&page=1>
{'review': 'Good staff behaviour also good taste', 'review_id': 280821392, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-02-27', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Inorbit Mall', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20587336}
2025-03-03 01:07:46 [reviews] INFO: Scraped item: {'review': 'nice food ', 'review_id': 280786092, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-02-27', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Inorbit Mall', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20587336}
2025-03-03 01:07:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20587336&page=1>
{'review': 'nice food ', 'review_id': 280786092, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-02-27', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Inorbit Mall', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20587336}
2025-03-03 01:07:46 [reviews] INFO: Scraped item: {'review': 'Value for money ', 'review_id': 280638197, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-02-26', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Inorbit Mall', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20587336}
2025-03-03 01:07:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20587336&page=1>
{'review': 'Value for money ', 'review_id': 280638197, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-02-26', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Inorbit Mall', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20587336}
2025-03-03 01:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20541482&page=1> (referer: None)
2025-03-03 01:07:47 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Veera Desai Area', 'platform': 'zomato', 'res_id': 20541482, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964005, 'download_latency': 6.90211033821106, 'depth': 0}
2025-03-03 01:07:47 [reviews] ERROR: Unrecognized relative_date format: 26 minutes ago
2025-03-03 01:07:47 [reviews] INFO: Stopping for res_id: 20541482 due to unrecognized date format: 26 minutes ago.
2025-03-03 01:07:48 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20516112&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20646811&page=1> (referer: None)
2025-03-03 01:07:53 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 20646811, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964016, 'download_latency': 0.9385027885437012, 'depth': 0}
2025-03-03 01:07:53 [reviews] INFO: Stopping for res_id: 20646811 as reviews are older than 7 days.
2025-03-03 01:07:55 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517146&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:07:59 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20388081&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:08:03 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20227195&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:08:06 [scrapy.extensions.logstats] INFO: Crawled 159 pages (at 4 pages/min), scraped 534 items (at 6 items/min)
2025-03-03 01:08:06 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20020341&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:08:09 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19845961&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:08:13 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19832717&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:08:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20420004&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:08:19 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20267173&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:08:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20284206&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:08:26 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19894306&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:08:30 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19856363&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20660045&page=1> (referer: None)
2025-03-03 01:08:35 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964058, 'download_latency': 0.9454779624938965, 'depth': 0}
2025-03-03 01:08:35 [reviews] INFO: Scraped item: {'review': "The parotta was dry and super hard to chew on. The mushroom was also very spicy. Didn't really enjoy the meal.", 'review_id': 282229994, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045}
2025-03-03 01:08:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20660045&page=1>
{'review': "The parotta was dry and super hard to chew on. The mushroom was also very spicy. Didn't really enjoy the meal.", 'review_id': 282229994, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045}
2025-03-03 01:08:35 [reviews] INFO: Scraped item: {'review': 'Did not receive salan', 'review_id': 282024312, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045}
2025-03-03 01:08:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20660045&page=1>
{'review': 'Did not receive salan', 'review_id': 282024312, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045}
2025-03-03 01:08:35 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281825702, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045}
2025-03-03 01:08:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20660045&page=1>
{'review': '', 'review_id': 281825702, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045}
2025-03-03 01:08:35 [reviews] INFO: Scraped item: {'review': 'Excellent customer service. Called the store to make an order request. The staff was incredibly helpful. <br/><br/>Pepper chicken fry was good. ', 'review_id': 281544819, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045}
2025-03-03 01:08:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20660045&page=1>
{'review': 'Excellent customer service. Called the store to make an order request. The staff was incredibly helpful. <br/><br/>Pepper chicken fry was good. ', 'review_id': 281544819, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045}
2025-03-03 01:08:35 [reviews] INFO: Scraped item: {'review': 'Very spicy and not so good. Unhealthy way of cooking. Dalcha and raita has no taste.', 'review_id': 281542597, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045}
2025-03-03 01:08:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20660045&page=1>
{'review': 'Very spicy and not so good. Unhealthy way of cooking. Dalcha and raita has no taste.', 'review_id': 281542597, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045}
2025-03-03 01:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20661130&page=1> (referer: None)
2025-03-03 01:08:39 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 37, 'brand_name': 'Blue Tokai Coffee Roasters', 'city': 'Bangalore', 'sub_zone': 'Domlur', 'platform': 'zomato', 'res_id': 20661130, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964066, 'download_latency': 0.8610813617706299, 'depth': 0}
2025-03-03 01:08:39 [reviews] INFO: Scraped item: {'review': "terrible no dip. when I asked the resturant why, he has the audacity to tell me that it is only for display. you charge so much and can't give one dip. ", 'review_id': 280899323, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 37, 'brand_name': 'Blue Tokai Coffee Roasters', 'city': 'Bangalore', 'sub_zone': 'Domlur', 'platform': 'zomato', 'res_id': 20661130}
2025-03-03 01:08:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20661130&page=1>
{'review': "terrible no dip. when I asked the resturant why, he has the audacity to tell me that it is only for display. you charge so much and can't give one dip. ", 'review_id': 280899323, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 37, 'brand_name': 'Blue Tokai Coffee Roasters', 'city': 'Bangalore', 'sub_zone': 'Domlur', 'platform': 'zomato', 'res_id': 20661130}
2025-03-03 01:08:39 [reviews] INFO: Stopping for res_id: 20661130 as reviews are older than 7 days.
2025-03-03 01:08:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20587336&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:08:45 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20516112&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20667565&page=1> (referer: None)
2025-03-03 01:08:49 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964073, 'download_latency': 0.8912456035614014, 'depth': 0}
2025-03-03 01:08:49 [reviews] INFO: Scraped item: {'review': 'Yazu was a perfect family time spent together. We ordered food truffle Edelman’s dumplings, Chenin Sui Mai, Californian veg sushi. The chef even made us the Butter garlic prawns which was off menu and they were a good portion. For main we came for Egg Fried Rice with Chicken and Chicken in Black Bean Sauce. For desserts 2 schools of Belgian chocolate icecream did it!', 'review_id': 281877902, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565}
2025-03-03 01:08:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20667565&page=1>
{'review': 'Yazu was a perfect family time spent together. We ordered food truffle Edelman’s dumplings, Chenin Sui Mai, Californian veg sushi. The chef even made us the Butter garlic prawns which was off menu and they were a good portion. For main we came for Egg Fried Rice with Chicken and Chicken in Black Bean Sauce. For desserts 2 schools of Belgian chocolate icecream did it!', 'review_id': 281877902, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565}
2025-03-03 01:08:49 [reviews] INFO: Scraped item: {'review': 'The sushi was very disappointing this time. The flavours were all off :(', 'review_id': 281684171, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565}
2025-03-03 01:08:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20667565&page=1>
{'review': 'The sushi was very disappointing this time. The flavours were all off :(', 'review_id': 281684171, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565}
2025-03-03 01:08:49 [reviews] INFO: Scraped item: {'review': 'I have been visiting Yazu for quite long time and the food is consistently amazing. The Veg Spicy Shirataki Noodles is light yet flavorful, and the desserts are a sweet surprise. Highly recommended for Asian food lovers.', 'review_id': 281371717, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-01', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565}
2025-03-03 01:08:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20667565&page=1>
{'review': 'I have been visiting Yazu for quite long time and the food is consistently amazing. The Veg Spicy Shirataki Noodles is light yet flavorful, and the desserts are a sweet surprise. Highly recommended for Asian food lovers.', 'review_id': 281371717, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-01', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565}
2025-03-03 01:08:49 [reviews] INFO: Scraped item: {'review': 'We had a great meal at Yazu. The Exotic Vegetables in Pumpkin Sauce and Chicken Lao Gan Ma made it a standout dish. The cocktails were innovative and refreshing. Loved the vibrant yet sophisticated decor.', 'review_id': 281218281, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-02-28', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565}
2025-03-03 01:08:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20667565&page=1>
{'review': 'We had a great meal at Yazu. The Exotic Vegetables in Pumpkin Sauce and Chicken Lao Gan Ma made it a standout dish. The cocktails were innovative and refreshing. Loved the vibrant yet sophisticated decor.', 'review_id': 281218281, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-02-28', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565}
2025-03-03 01:08:49 [reviews] INFO: Scraped item: {'review': "If you want to have an awesome Asian meal, then you must head to Yazu. The food quality is outstanding. The service is very efficient and you don't get any chance to complain. Everything is perfect.", 'review_id': 281214865, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-02-28', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565}
2025-03-03 01:08:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20667565&page=1>
{'review': "If you want to have an awesome Asian meal, then you must head to Yazu. The food quality is outstanding. The service is very efficient and you don't get any chance to complain. Everything is perfect.", 'review_id': 281214865, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-02-28', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565}
2025-03-03 01:08:53 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517146&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:08:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20388081&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:09:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20227195&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:09:04 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20020341&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:09:06 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 3 pages/min), scraped 545 items (at 11 items/min)
2025-03-03 01:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20682991&page=1> (referer: None)
2025-03-03 01:09:08 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 47, 'brand_name': 'ASIE', 'city': 'Hyderabad', 'sub_zone': 'Gachibowli', 'platform': 'zomato', 'res_id': 20682991, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964090, 'download_latency': 0.8872394561767578, 'depth': 0}
2025-03-03 01:09:08 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281895684, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 47, 'brand_name': 'ASIE', 'city': 'Hyderabad', 'sub_zone': 'Gachibowli', 'platform': 'zomato', 'res_id': 20682991}
2025-03-03 01:09:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20682991&page=1>
{'review': '', 'review_id': 281895684, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 47, 'brand_name': 'ASIE', 'city': 'Hyderabad', 'sub_zone': 'Gachibowli', 'platform': 'zomato', 'res_id': 20682991}
2025-03-03 01:09:08 [reviews] INFO: Scraped item: {'review': 'taste is good. ', 'review_id': 281602917, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 47, 'brand_name': 'ASIE', 'city': 'Hyderabad', 'sub_zone': 'Gachibowli', 'platform': 'zomato', 'res_id': 20682991}
2025-03-03 01:09:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20682991&page=1>
{'review': 'taste is good. ', 'review_id': 281602917, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 47, 'brand_name': 'ASIE', 'city': 'Hyderabad', 'sub_zone': 'Gachibowli', 'platform': 'zomato', 'res_id': 20682991}
2025-03-03 01:09:08 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281599280, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 47, 'brand_name': 'ASIE', 'city': 'Hyderabad', 'sub_zone': 'Gachibowli', 'platform': 'zomato', 'res_id': 20682991}
2025-03-03 01:09:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20682991&page=1>
{'review': '', 'review_id': 281599280, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 47, 'brand_name': 'ASIE', 'city': 'Hyderabad', 'sub_zone': 'Gachibowli', 'platform': 'zomato', 'res_id': 20682991}
2025-03-03 01:09:08 [reviews] INFO: Stopping for res_id: 20682991 as reviews are older than 7 days.
2025-03-03 01:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20789516&page=1> (referer: None)
2025-03-03 01:09:12 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 3, 'brand_name': 'JuCo Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 20789516, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964093, 'download_latency': 0.8898000717163086, 'depth': 0}
2025-03-03 01:09:12 [reviews] INFO: Scraped item: {'review': 'The food was below average for the price. We ordered Turkish eggs, sourdough was not even toasted properly, was probably stale. Mushroom truffle oil toast was average. Matcha latte was also bad.', 'review_id': 281226128, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-02-28', 'competitor_id': 3, 'brand_name': 'JuCo Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 20789516}
2025-03-03 01:09:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20789516&page=1>
{'review': 'The food was below average for the price. We ordered Turkish eggs, sourdough was not even toasted properly, was probably stale. Mushroom truffle oil toast was average. Matcha latte was also bad.', 'review_id': 281226128, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-02-28', 'competitor_id': 3, 'brand_name': 'JuCo Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 20789516}
2025-03-03 01:09:12 [reviews] INFO: Scraped item: {'review': 'Excellent food consistently', 'review_id': 280462114, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 3, 'brand_name': 'JuCo Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 20789516}
2025-03-03 01:09:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20789516&page=1>
{'review': 'Excellent food consistently', 'review_id': 280462114, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 3, 'brand_name': 'JuCo Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 20789516}
2025-03-03 01:09:12 [reviews] INFO: Stopping for res_id: 20789516 as reviews are older than 7 days.
2025-03-03 01:09:15 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20420004&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:09:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20267173&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:09:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20284206&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20816697&page=1> (referer: None)
2025-03-03 01:09:27 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Ahmedabad ', 'sub_zone': 'Palladium Mall', 'platform': 'zomato', 'res_id': 20816697, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964107, 'download_latency': 0.8891980648040771, 'depth': 0}
2025-03-03 01:09:27 [reviews] INFO: Scraped item: {'review': '', 'review_id': 282208249, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Ahmedabad ', 'sub_zone': 'Palladium Mall', 'platform': 'zomato', 'res_id': 20816697}
2025-03-03 01:09:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20816697&page=1>
{'review': '', 'review_id': 282208249, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Ahmedabad ', 'sub_zone': 'Palladium Mall', 'platform': 'zomato', 'res_id': 20816697}
2025-03-03 01:09:27 [reviews] INFO: Scraped item: {'review': '', 'review_id': 282087566, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Ahmedabad ', 'sub_zone': 'Palladium Mall', 'platform': 'zomato', 'res_id': 20816697}
2025-03-03 01:09:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20816697&page=1>
{'review': '', 'review_id': 282087566, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Ahmedabad ', 'sub_zone': 'Palladium Mall', 'platform': 'zomato', 'res_id': 20816697}
2025-03-03 01:09:27 [reviews] INFO: Scraped item: {'review': 'Great 👍 ', 'review_id': 281062760, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Ahmedabad ', 'sub_zone': 'Palladium Mall', 'platform': 'zomato', 'res_id': 20816697}
2025-03-03 01:09:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20816697&page=1>
{'review': 'Great 👍 ', 'review_id': 281062760, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Ahmedabad ', 'sub_zone': 'Palladium Mall', 'platform': 'zomato', 'res_id': 20816697}
2025-03-03 01:09:27 [reviews] INFO: Stopping for res_id: 20816697 as reviews are older than 7 days.
2025-03-03 01:09:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20828825&page=1> (referer: None)
2025-03-03 01:09:30 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20828825, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964111, 'download_latency': 0.920191764831543, 'depth': 0}
2025-03-03 01:09:30 [reviews] INFO: Scraped item: {'review': 'Super cold and became chewy. Did not enjoy the pizza at all', 'review_id': 281799434, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20828825}
2025-03-03 01:09:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20828825&page=1>
{'review': 'Super cold and became chewy. Did not enjoy the pizza at all', 'review_id': 281799434, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20828825}
2025-03-03 01:09:30 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281231360, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20828825}
2025-03-03 01:09:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20828825&page=1>
{'review': '', 'review_id': 281231360, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20828825}
2025-03-03 01:09:30 [reviews] INFO: Scraped item: {'review': 'The pasta is not cooked properly', 'review_id': 281212047, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20828825}
2025-03-03 01:09:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20828825&page=1>
{'review': 'The pasta is not cooked properly', 'review_id': 281212047, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20828825}
2025-03-03 01:09:30 [reviews] INFO: Scraped item: {'review': "tummy upset because of the cheese they're using ", 'review_id': 281184099, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20828825}
2025-03-03 01:09:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20828825&page=1>
{'review': "tummy upset because of the cheese they're using ", 'review_id': 281184099, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20828825}
2025-03-03 01:09:30 [reviews] INFO: Stopping for res_id: 20828825 as reviews are older than 7 days.
2025-03-03 01:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20844186&page=1> (referer: None)
2025-03-03 01:09:32 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964115, 'download_latency': 0.9277565479278564, 'depth': 0}
2025-03-03 01:09:32 [reviews] INFO: Scraped item: {'review': 'Good taste on time delivery ', 'review_id': 282236957, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186}
2025-03-03 01:09:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20844186&page=1>
{'review': 'Good taste on time delivery ', 'review_id': 282236957, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186}
2025-03-03 01:09:32 [reviews] INFO: Scraped item: {'review': 'masala was not enough ', 'review_id': 282194815, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186}
2025-03-03 01:09:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20844186&page=1>
{'review': 'masala was not enough ', 'review_id': 282194815, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186}
2025-03-03 01:09:32 [reviews] INFO: Scraped item: {'review': 'loved it this time with proper masala and good amount of chicken as well 😋', 'review_id': 282186915, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186}
2025-03-03 01:09:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20844186&page=1>
{'review': 'loved it this time with proper masala and good amount of chicken as well 😋', 'review_id': 282186915, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186}
2025-03-03 01:09:32 [reviews] INFO: Scraped item: {'review': 'portion size should be bigger for the price being charged', 'review_id': 281793094, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186}
2025-03-03 01:09:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20844186&page=1>
{'review': 'portion size should be bigger for the price being charged', 'review_id': 281793094, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186}
2025-03-03 01:09:32 [reviews] INFO: Scraped item: {'review': 'Till now This is the best restaurant that I have seen in delhi....on top of that I recommended for southern people and I tried 5 items in this ❤️\u200d🩹', 'review_id': 281723987, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186}
2025-03-03 01:09:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20844186&page=1>
{'review': 'Till now This is the best restaurant that I have seen in delhi....on top of that I recommended for southern people and I tried 5 items in this ❤️\u200d🩹', 'review_id': 281723987, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186}
2025-03-03 01:09:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20660045&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:09:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20587336&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:09:43 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20516112&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20880681&page=1> (referer: None)
2025-03-03 01:09:49 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964130, 'download_latency': 2.302304983139038, 'depth': 0}
2025-03-03 01:09:49 [reviews] INFO: Scraped item: {'review': 'Gulab jamun was unpleasant smelling ', 'review_id': 282240356, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681}
2025-03-03 01:09:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20880681&page=1>
{'review': 'Gulab jamun was unpleasant smelling ', 'review_id': 282240356, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681}
2025-03-03 01:09:49 [reviews] INFO: Scraped item: {'review': 'Ymmyy taste', 'review_id': 282190457, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681}
2025-03-03 01:09:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20880681&page=1>
{'review': 'Ymmyy taste', 'review_id': 282190457, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681}
2025-03-03 01:09:49 [reviews] INFO: Scraped item: {'review': 'tooo goood', 'review_id': 282094406, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681}
2025-03-03 01:09:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20880681&page=1>
{'review': 'tooo goood', 'review_id': 282094406, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681}
2025-03-03 01:09:49 [reviews] INFO: Scraped item: {'review': 'no extra items delivered', 'review_id': 281989622, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681}
2025-03-03 01:09:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20880681&page=1>
{'review': 'no extra items delivered', 'review_id': 281989622, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681}
2025-03-03 01:09:49 [reviews] INFO: Scraped item: {'review': 'not provided chutney and onion even after tell', 'review_id': 281776734, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681}
2025-03-03 01:09:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20880681&page=1>
{'review': 'not provided chutney and onion even after tell', 'review_id': 281776734, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681}
2025-03-03 01:09:51 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20667565&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:09:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517146&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:09:59 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20388081&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:10:03 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20227195&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2025-03-03 01:10:06 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108
2025-03-03 01:10:06 [scrapy.extensions.logstats] INFO: Crawled 168 pages (at 6 pages/min), scraped 567 items (at 22 items/min)
2025-03-03 01:10:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20895131&page=1> (referer: None)
2025-03-03 01:10:07 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 3, 'brand_name': 'Achija', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 20895131, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964148, 'download_latency': 0.935025691986084, 'depth': 0}
2025-03-03 01:10:07 [reviews] INFO: Scraped item: {'review': 'Service was good.. ordered fried rice and chilli paneer and they were really good.. ambience is also beautiful..', 'review_id': 281737458, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 3, 'brand_name': 'Achija', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 20895131}
2025-03-03 01:10:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20895131&page=1>
{'review': 'Service was good.. ordered fried rice and chilli paneer and they were really good.. ambience is also beautiful..', 'review_id': 281737458, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 3, 'brand_name': 'Achija', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 20895131}
2025-03-03 01:10:07 [reviews] INFO: Stopping for res_id: 20895131 as reviews are older than 7 days.
2025-03-03 01:10:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20896097&page=1> (referer: None)
2025-03-03 01:10:12 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964152, 'download_latency': 0.7178435325622559, 'depth': 0}
2025-03-03 01:10:12 [reviews] INFO: Scraped item: {'review': 'very good food', 'review_id': 282211049, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097}
2025-03-03 01:10:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20896097&page=1>
{'review': 'very good food', 'review_id': 282211049, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097}
2025-03-03 01:10:12 [reviews] INFO: Scraped item: {'review': 'Cream Centre a fab place to go out with family have awesome food with well lit up and happy ambience. Servers / Waiters / Attendants are on toes and provide good service! A must go place if you are searching a family dining place!', 'review_id': 281807096, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097}
2025-03-03 01:10:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20896097&page=1>
{'review': 'Cream Centre a fab place to go out with family have awesome food with well lit up and happy ambience. Servers / Waiters / Attendants are on toes and provide good service! A must go place if you are searching a family dining place!', 'review_id': 281807096, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097}
2025-03-03 01:10:12 [reviews] INFO: Scraped item: {'review': 'We ordered Veggie overloaded Pizza. The crust was dry and undercooked. We couldn’t taste the sauce, cheese and veggies was all we could taste. Very average.<br/>Then we ordered Fajita sizzler. The Nacho didn’t taste like Nacho, it tasted like papad but without the crunch. The veggies and their sauce were not tasty and too sour. Only 1 cheese ball. We also saw people returning the same food items which we ordered. All this at a very high price point, totally not worth it.<br/>Very disappointing and we won’t be going back!', 'review_id': 281108522, 'rating': '2', 'review_type': 'DINING', 'review_date': '2025-02-28', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097}
2025-03-03 01:10:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20896097&page=1>
{'review': 'We ordered Veggie overloaded Pizza. The crust was dry and undercooked. We couldn’t taste the sauce, cheese and veggies was all we could taste. Very average.<br/>Then we ordered Fajita sizzler. The Nacho didn’t taste like Nacho, it tasted like papad but without the crunch. The veggies and their sauce were not tasty and too sour. Only 1 cheese ball. We also saw people returning the same food items which we ordered. All this at a very high price point, totally not worth it.<br/>Very disappointing and we won’t be going back!', 'review_id': 281108522, 'rating': '2', 'review_type': 'DINING', 'review_date': '2025-02-28', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097}
2025-03-03 01:10:12 [reviews] INFO: Scraped item: {'review': 'The food was really amazing, Ghar wali feeling', 'review_id': 281093999, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-02-28', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097}
2025-03-03 01:10:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20896097&page=1>
{'review': 'The food was really amazing, Ghar wali feeling', 'review_id': 281093999, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-02-28', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097}
2025-03-03 01:10:12 [reviews] INFO: Scraped item: {'review': 'Above average food at exorbitant price. There are far better restaurants in Thane.<br/><br/>This place is completely avoidable. ', 'review_id': 280569881, 'rating': '2', 'review_type': 'DINING', 'review_date': '2025-02-26', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097}
2025-03-03 01:10:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20896097&page=1>
{'review': 'Above average food at exorbitant price. There are far better restaurants in Thane.<br/><br/>This place is completely avoidable. ', 'review_id': 280569881, 'rating': '2', 'review_type': 'DINING', 'review_date': '2025-02-26', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097}
2025-03-03 01:10:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20420004&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:10:18 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20267173&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:10:22 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20284206&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20907523&page=1> (referer: None)
2025-03-03 01:10:28 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964167, 'download_latency': 1.8495488166809082, 'depth': 0}
2025-03-03 01:10:28 [reviews] INFO: Scraped item: {'review': 'the raita which was send was khatta ....briyani was good...', 'review_id': 282224331, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523}
2025-03-03 01:10:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20907523&page=1>
{'review': 'the raita which was send was khatta ....briyani was good...', 'review_id': 282224331, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523}
2025-03-03 01:10:28 [reviews] INFO: Scraped item: {'review': 'Extremely Bad. The Bhature had become like papad with no question of it being fluffy or layered.', 'review_id': 282205944, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523}
2025-03-03 01:10:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20907523&page=1>
{'review': 'Extremely Bad. The Bhature had become like papad with no question of it being fluffy or layered.', 'review_id': 282205944, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523}
2025-03-03 01:10:28 [reviews] INFO: Scraped item: {'review': 'it was too d3layed this time', 'review_id': 282185906, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523}
2025-03-03 01:10:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20907523&page=1>
{'review': 'it was too d3layed this time', 'review_id': 282185906, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523}
2025-03-03 01:10:28 [reviews] INFO: Scraped item: {'review': 'Great going. ', 'review_id': 281689630, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523}
2025-03-03 01:10:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20907523&page=1>
{'review': 'Great going. ', 'review_id': 281689630, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523}
2025-03-03 01:10:28 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281524374, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523}
2025-03-03 01:10:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20907523&page=1>
{'review': '', 'review_id': 281524374, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523}
2025-03-03 01:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20998125&page=1> (referer: None)
2025-03-03 01:10:31 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964170, 'download_latency': 1.0079421997070312, 'depth': 0}
2025-03-03 01:10:31 [reviews] INFO: Scraped item: {'review': 'Anil was of great service', 'review_id': 282150290, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125}
2025-03-03 01:10:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20998125&page=1>
{'review': 'Anil was of great service', 'review_id': 282150290, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125}
2025-03-03 01:10:31 [reviews] INFO: Scraped item: {'review': 'soya sauce was very less and not enough', 'review_id': 281445469, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125}
2025-03-03 01:10:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20998125&page=1>
{'review': 'soya sauce was very less and not enough', 'review_id': 281445469, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125}
2025-03-03 01:10:31 [reviews] INFO: Scraped item: {'review': "I ordered the non veg bento box. First up, the food had become cold by the time it reached. Can't say much about that except maybe restaurant can look at foil wrapping the box. Don't go by the smaller container of starter - it was literally tightly packed with chicken. The portion I feel is fairly generous. Only surprise in the package was the domain's - they tasted like they had come from a corner Momo shop - absolutely bland and tasteless. Rest of the food including dessert was top notch.", 'review_id': 281398699, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125}
2025-03-03 01:10:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20998125&page=1>
{'review': "I ordered the non veg bento box. First up, the food had become cold by the time it reached. Can't say much about that except maybe restaurant can look at foil wrapping the box. Don't go by the smaller container of starter - it was literally tightly packed with chicken. The portion I feel is fairly generous. Only surprise in the package was the domain's - they tasted like they had come from a corner Momo shop - absolutely bland and tasteless. Rest of the food including dessert was top notch.", 'review_id': 281398699, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125}
2025-03-03 01:10:31 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281366984, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125}
2025-03-03 01:10:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20998125&page=1>
{'review': '', 'review_id': 281366984, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125}
2025-03-03 01:10:31 [reviews] INFO: Scraped item: {'review': 'Horrible taste. Nothing is authentic. We ordered Ramen bowel which was just boil water and vegetables absolutely no broth taste. Most worst experience. Thats why they offer 30% off coz they know quality is not their cup of tea.', 'review_id': 280478462, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-02-26', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125}
2025-03-03 01:10:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20998125&page=1>
{'review': 'Horrible taste. Nothing is authentic. We ordered Ramen bowel which was just boil water and vegetables absolutely no broth taste. Most worst experience. Thats why they offer 30% off coz they know quality is not their cup of tea.', 'review_id': 280478462, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-02-26', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125}
2025-03-03 01:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21012857&page=1> (referer: None)
2025-03-03 01:10:35 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 48, 'brand_name': 'Sakura - A Far Eastern Kitchen', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 21012857, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964173, 'download_latency': 0.9358358383178711, 'depth': 0}
2025-03-03 01:10:35 [reviews] INFO: Stopping for res_id: 21012857 as reviews are older than 7 days.
2025-03-03 01:10:38 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20844186&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:10:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20660045&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:10:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20587336&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:10:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20516112&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:10:53 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20880681&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:10:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20667565&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:11:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517146&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:11:04 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20388081&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:11:06 [scrapy.extensions.logstats] INFO: Crawled 173 pages (at 5 pages/min), scraped 583 items (at 16 items/min)
2025-03-03 01:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21031542&page=1> (referer: None)
2025-03-03 01:11:08 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 29, 'brand_name': 'abCoffee', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21031542, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964208, 'download_latency': 1.5990791320800781, 'depth': 0}
2025-03-03 01:11:08 [reviews] INFO: Scraped item: {'review': 'Received small cap on a big cup because of which my coffee has spilled', 'review_id': 280892915, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 29, 'brand_name': 'abCoffee', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21031542}
2025-03-03 01:11:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21031542&page=1>
{'review': 'Received small cap on a big cup because of which my coffee has spilled', 'review_id': 280892915, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 29, 'brand_name': 'abCoffee', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21031542}
2025-03-03 01:11:08 [reviews] INFO: Scraped item: {'review': 'Loved it. ', 'review_id': 280369620, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 29, 'brand_name': 'abCoffee', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21031542}
2025-03-03 01:11:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21031542&page=1>
{'review': 'Loved it. ', 'review_id': 280369620, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 29, 'brand_name': 'abCoffee', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21031542}
2025-03-03 01:11:08 [reviews] INFO: Scraped item: {'review': 'Tasteless hot chocolate', 'review_id': 280230992, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 29, 'brand_name': 'abCoffee', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21031542}
2025-03-03 01:11:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21031542&page=1>
{'review': 'Tasteless hot chocolate', 'review_id': 280230992, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 29, 'brand_name': 'abCoffee', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21031542}
2025-03-03 01:11:08 [reviews] INFO: Stopping for res_id: 21031542 as reviews are older than 7 days.
2025-03-03 01:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21061214&page=1> (referer: None)
2025-03-03 01:11:11 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 3', 'platform': 'zomato', 'res_id': 21061214, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964212, 'download_latency': 0.9016764163970947, 'depth': 0}
2025-03-03 01:11:11 [reviews] INFO: Scraped item: {'review': 'Very stupid team you have...my request was printed on the bill & attached to the order...Hats off', 'review_id': 281778521, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 3', 'platform': 'zomato', 'res_id': 21061214}
2025-03-03 01:11:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21061214&page=1>
{'review': 'Very stupid team you have...my request was printed on the bill & attached to the order...Hats off', 'review_id': 281778521, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 3', 'platform': 'zomato', 'res_id': 21061214}
2025-03-03 01:11:11 [reviews] INFO: Scraped item: {'review': 'Quantity is so less, this is unacceptable ', 'review_id': 281257179, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 3', 'platform': 'zomato', 'res_id': 21061214}
2025-03-03 01:11:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21061214&page=1>
{'review': 'Quantity is so less, this is unacceptable ', 'review_id': 281257179, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 3', 'platform': 'zomato', 'res_id': 21061214}
2025-03-03 01:11:11 [reviews] INFO: Scraped item: {'review': 'Mayonnaise!!! Yuck', 'review_id': 281219606, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 3', 'platform': 'zomato', 'res_id': 21061214}
2025-03-03 01:11:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21061214&page=1>
{'review': 'Mayonnaise!!! Yuck', 'review_id': 281219606, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 3', 'platform': 'zomato', 'res_id': 21061214}
2025-03-03 01:11:11 [reviews] INFO: Stopping for res_id: 21061214 as reviews are older than 7 days.
2025-03-03 01:11:15 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20896097&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:11:17 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20420004&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21091083&page=1> (referer: None)
2025-03-03 01:11:22 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 29, 'brand_name': 'abCoffee', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 21091083, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964222, 'download_latency': 0.9980075359344482, 'depth': 0}
2025-03-03 01:11:22 [reviews] INFO: Scraped item: {'review': 'Didnt expect it to be this salty didnt taste like coffee or good at all', 'review_id': 281253830, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 29, 'brand_name': 'abCoffee', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 21091083}
2025-03-03 01:11:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21091083&page=1>
{'review': 'Didnt expect it to be this salty didnt taste like coffee or good at all', 'review_id': 281253830, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 29, 'brand_name': 'abCoffee', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 21091083}
2025-03-03 01:11:22 [reviews] INFO: Stopping for res_id: 21091083 as reviews are older than 7 days.
2025-03-03 01:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21131421&page=1> (referer: None)
2025-03-03 01:11:25 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964228, 'download_latency': 0.7627544403076172, 'depth': 0}
2025-03-03 01:11:25 [reviews] INFO: Scraped item: {'review': 'This is not Hyderabadi Biryani <br/>Fraud and cheating ', 'review_id': 282207688, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421}
2025-03-03 01:11:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21131421&page=1>
{'review': 'This is not Hyderabadi Biryani <br/>Fraud and cheating ', 'review_id': 282207688, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421}
2025-03-03 01:11:25 [reviews] INFO: Scraped item: {'review': 'Not at all good. Looks like biryani but tastes different.', 'review_id': 282025234, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421}
2025-03-03 01:11:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21131421&page=1>
{'review': 'Not at all good. Looks like biryani but tastes different.', 'review_id': 282025234, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421}
2025-03-03 01:11:25 [reviews] INFO: Scraped item: {'review': 'ordered food was very salty today could not even eat it', 'review_id': 281782807, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421}
2025-03-03 01:11:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21131421&page=1>
{'review': 'ordered food was very salty today could not even eat it', 'review_id': 281782807, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421}
2025-03-03 01:11:25 [reviews] INFO: Scraped item: {'review': 'kaccha food', 'review_id': 281660475, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421}
2025-03-03 01:11:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21131421&page=1>
{'review': 'kaccha food', 'review_id': 281660475, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421}
2025-03-03 01:11:25 [reviews] INFO: Scraped item: {'review': 'Decent quantity- good taste- 1/2 portions of mutton undercooked in mutton biryani. Lots of room for improvement.', 'review_id': 281313613, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421}
2025-03-03 01:11:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21131421&page=1>
{'review': 'Decent quantity- good taste- 1/2 portions of mutton undercooked in mutton biryani. Lots of room for improvement.', 'review_id': 281313613, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421}
2025-03-03 01:11:28 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20907523&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:11:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20998125&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:11:35 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20844186&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:11:39 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20660045&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:11:43 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20587336&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:11:48 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20516112&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:11:51 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20880681&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:11:55 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20667565&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:11:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517146&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21144195&page=1> (referer: None)
2025-03-03 01:12:03 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Khar', 'platform': 'zomato', 'res_id': 21144195, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964264, 'download_latency': 2.204723596572876, 'depth': 0}
2025-03-03 01:12:03 [reviews] INFO: Scraped item: {'review': 'Good food', 'review_id': 281644449, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Khar', 'platform': 'zomato', 'res_id': 21144195}
2025-03-03 01:12:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21144195&page=1>
{'review': 'Good food', 'review_id': 281644449, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-02', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Khar', 'platform': 'zomato', 'res_id': 21144195}
2025-03-03 01:12:03 [reviews] INFO: Scraped item: {'review': 'the noodles were not tasting good..no veggies is the noodles ', 'review_id': 280972922, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Khar', 'platform': 'zomato', 'res_id': 21144195}
2025-03-03 01:12:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21144195&page=1>
{'review': 'the noodles were not tasting good..no veggies is the noodles ', 'review_id': 280972922, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Khar', 'platform': 'zomato', 'res_id': 21144195}
2025-03-03 01:12:03 [reviews] INFO: Scraped item: {'review': 'not even edible', 'review_id': 280550207, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Khar', 'platform': 'zomato', 'res_id': 21144195}
2025-03-03 01:12:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21144195&page=1>
{'review': 'not even edible', 'review_id': 280550207, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Khar', 'platform': 'zomato', 'res_id': 21144195}
2025-03-03 01:12:03 [reviews] INFO: Stopping for res_id: 21144195 as reviews are older than 7 days.
2025-03-03 01:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21146712&page=1> (referer: None)
2025-03-03 01:12:06 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 21146712, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964268, 'download_latency': 1.1351606845855713, 'depth': 0}
2025-03-03 01:12:06 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281446566, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 21146712}
2025-03-03 01:12:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21146712&page=1>
{'review': '', 'review_id': 281446566, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 21146712}
2025-03-03 01:12:06 [reviews] INFO: Scraped item: {'review': 'Good ', 'review_id': 281036451, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 21146712}
2025-03-03 01:12:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21146712&page=1>
{'review': 'Good ', 'review_id': 281036451, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 21146712}
2025-03-03 01:12:06 [reviews] INFO: Scraped item: {'review': 'excellent taste and it was very best and sufficient in  quality and quantity 👌 😋 ', 'review_id': 280828441, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 21146712}
2025-03-03 01:12:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21146712&page=1>
{'review': 'excellent taste and it was very best and sufficient in  quality and quantity 👌 😋 ', 'review_id': 280828441, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 21146712}
2025-03-03 01:12:06 [reviews] INFO: Stopping for res_id: 21146712 as reviews are older than 7 days.
2025-03-03 01:12:06 [scrapy.extensions.logstats] INFO: Crawled 179 pages (at 6 pages/min), scraped 601 items (at 18 items/min)
2025-03-03 01:12:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21227450&page=1> (referer: None)
2025-03-03 01:12:10 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964271, 'download_latency': 0.9872453212738037, 'depth': 0}
2025-03-03 01:12:10 [reviews] INFO: Scraped item: {'review': "didn't god the gulabjam as mentioned in the combo", 'review_id': 281811450, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450}
2025-03-03 01:12:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21227450&page=1>
{'review': "didn't god the gulabjam as mentioned in the combo", 'review_id': 281811450, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450}
2025-03-03 01:12:10 [reviews] INFO: Scraped item: {'review': 'only half of the egg was given in the pack. Horrible experience. I have felt degradation in the taste and chicken quality as well. ', 'review_id': 281713244, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450}
2025-03-03 01:12:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21227450&page=1>
{'review': 'only half of the egg was given in the pack. Horrible experience. I have felt degradation in the taste and chicken quality as well. ', 'review_id': 281713244, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450}
2025-03-03 01:12:10 [reviews] INFO: Scraped item: {'review': 'biryani was good and tasty..all must try the biryani with pocket friendly with amazing taste', 'review_id': 280971304, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450}
2025-03-03 01:12:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21227450&page=1>
{'review': 'biryani was good and tasty..all must try the biryani with pocket friendly with amazing taste', 'review_id': 280971304, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450}
2025-03-03 01:12:10 [reviews] INFO: Scraped item: {'review': 'good packing taste was yummy ', 'review_id': 280773535, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450}
2025-03-03 01:12:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21227450&page=1>
{'review': 'good packing taste was yummy ', 'review_id': 280773535, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450}
2025-03-03 01:12:10 [reviews] INFO: Scraped item: {'review': "One of the best Briyani's", 'review_id': 280460135, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450}
2025-03-03 01:12:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21227450&page=1>
{'review': "One of the best Briyani's", 'review_id': 280460135, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450}
2025-03-03 01:12:12 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20896097&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21240266&page=1> (referer: None)
2025-03-03 01:12:17 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 21240266, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964277, 'download_latency': 1.618361234664917, 'depth': 0}
2025-03-03 01:12:17 [reviews] INFO: Scraped item: {'review': '', 'review_id': 282097179, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 21240266}
2025-03-03 01:12:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21240266&page=1>
{'review': '', 'review_id': 282097179, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 21240266}
2025-03-03 01:12:17 [reviews] INFO: Scraped item: {'review': 'quantity is very less according to price', 'review_id': 281862869, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 21240266}
2025-03-03 01:12:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21240266&page=1>
{'review': 'quantity is very less according to price', 'review_id': 281862869, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 21240266}
2025-03-03 01:12:17 [reviews] INFO: Scraped item: {'review': 'This has been the far Best beetroot and chicken roll. The chicken is so fresh and juicy.', 'review_id': 281167067, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 21240266}
2025-03-03 01:12:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21240266&page=1>
{'review': 'This has been the far Best beetroot and chicken roll. The chicken is so fresh and juicy.', 'review_id': 281167067, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 21240266}
2025-03-03 01:12:17 [reviews] INFO: Scraped item: {'review': 'The afghani chicken disappointed a lot , completely awful , the chicken was half cooked.  Biryani was good , the pieces of chicken were properly cooked, and taste was delicious .', 'review_id': 281049762, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 21240266}
2025-03-03 01:12:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21240266&page=1>
{'review': 'The afghani chicken disappointed a lot , completely awful , the chicken was half cooked.  Biryani was good , the pieces of chicken were properly cooked, and taste was delicious .', 'review_id': 281049762, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 21240266}
2025-03-03 01:12:17 [reviews] INFO: Scraped item: {'review': 'If I were to be brief—there is absolutely no flavor in the Biryani. But that doesn’t necessarily make it bad. Most standardized biryani brands keep everything moderate, like a minimalist theme for a circus party.<br/><br/>Nothing is too intense or too sharp. Nothing stands out. It’s just... a biryani. A nice simple Biryani.', 'review_id': 280188347, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 21240266}
2025-03-03 01:12:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21240266&page=1>
{'review': 'If I were to be brief—there is absolutely no flavor in the Biryani. But that doesn’t necessarily make it bad. Most standardized biryani brands keep everything moderate, like a minimalist theme for a circus party.<br/><br/>Nothing is too intense or too sharp. Nothing stands out. It’s just... a biryani. A nice simple Biryani.', 'review_id': 280188347, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 21240266}
2025-03-03 01:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21264546&page=1> (referer: None)
2025-03-03 01:12:19 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964282, 'download_latency': 0.8784785270690918, 'depth': 0}
2025-03-03 01:12:19 [reviews] INFO: Scraped item: {'review': '', 'review_id': 282103745, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546}
2025-03-03 01:12:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21264546&page=1>
{'review': '', 'review_id': 282103745, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546}
2025-03-03 01:12:19 [reviews] INFO: Scraped item: {'review': 'prateek was helpful. rabdi was tasty and felt to eat more. <br/>kachori was bland ', 'review_id': 281697575, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546}
2025-03-03 01:12:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21264546&page=1>
{'review': 'prateek was helpful. rabdi was tasty and felt to eat more. <br/>kachori was bland ', 'review_id': 281697575, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546}
2025-03-03 01:12:19 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281435982, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546}
2025-03-03 01:12:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21264546&page=1>
{'review': '', 'review_id': 281435982, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546}
2025-03-03 01:12:19 [reviews] INFO: Scraped item: {'review': 'Fantastic quality , Gajare k halwa was one of the best I had in a long time', 'review_id': 280892442, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546}
2025-03-03 01:12:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21264546&page=1>
{'review': 'Fantastic quality , Gajare k halwa was one of the best I had in a long time', 'review_id': 280892442, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546}
2025-03-03 01:12:19 [reviews] INFO: Scraped item: {'review': 'immediate consumption food Sent ', 'review_id': 280751870, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546}
2025-03-03 01:12:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21264546&page=1>
{'review': 'immediate consumption food Sent ', 'review_id': 280751870, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546}
2025-03-03 01:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21275729&page=1> (referer: None)
2025-03-03 01:12:23 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964286, 'download_latency': 0.9557123184204102, 'depth': 0}
2025-03-03 01:12:23 [reviews] INFO: Scraped item: {'review': '', 'review_id': 282186474, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729}
2025-03-03 01:12:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21275729&page=1>
{'review': '', 'review_id': 282186474, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729}
2025-03-03 01:12:23 [reviews] INFO: Scraped item: {'review': '', 'review_id': 282150422, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729}
2025-03-03 01:12:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21275729&page=1>
{'review': '', 'review_id': 282150422, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729}
2025-03-03 01:12:23 [reviews] INFO: Scraped item: {'review': '', 'review_id': 282023423, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729}
2025-03-03 01:12:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21275729&page=1>
{'review': '', 'review_id': 282023423, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729}
2025-03-03 01:12:23 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281073239, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729}
2025-03-03 01:12:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21275729&page=1>
{'review': '', 'review_id': 281073239, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729}
2025-03-03 01:12:23 [reviews] INFO: Scraped item: {'review': 'It was bitter taste', 'review_id': 280210149, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729}
2025-03-03 01:12:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21275729&page=1>
{'review': 'It was bitter taste', 'review_id': 280210149, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729}
2025-03-03 01:12:26 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21131421&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:12:29 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20998125&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:12:33 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20907523&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:12:37 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20844186&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:12:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20660045&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:12:43 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20587336&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:12:47 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20880681&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:12:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20667565&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:12:54 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517146&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:12:58 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20516112&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21330620&page=1> (referer: None)
2025-03-03 01:13:04 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Navi Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21330620, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964326, 'download_latency': 2.0297205448150635, 'depth': 0}
2025-03-03 01:13:04 [reviews] INFO: Scraped item: {'review': 'Little bit spicy and too oily rice others items are too good and tasty ...', 'review_id': 281985383, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Navi Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21330620}
2025-03-03 01:13:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21330620&page=1>
{'review': 'Little bit spicy and too oily rice others items are too good and tasty ...', 'review_id': 281985383, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Navi Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21330620}
2025-03-03 01:13:04 [reviews] INFO: Stopping for res_id: 21330620 as reviews are older than 7 days.
2025-03-03 01:13:06 [scrapy.extensions.logstats] INFO: Crawled 184 pages (at 5 pages/min), scraped 622 items (at 21 items/min)
2025-03-03 01:13:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21393822&page=1> (referer: None)
2025-03-03 01:13:07 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21393822, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964330, 'download_latency': 0.8288612365722656, 'depth': 0}
2025-03-03 01:13:07 [reviews] INFO: Scraped item: {'review': 'delicious', 'review_id': 282054649, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21393822}
2025-03-03 01:13:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21393822&page=1>
{'review': 'delicious', 'review_id': 282054649, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21393822}
2025-03-03 01:13:07 [reviews] INFO: Scraped item: {'review': 'Bad packaging', 'review_id': 281173794, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21393822}
2025-03-03 01:13:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21393822&page=1>
{'review': 'Bad packaging', 'review_id': 281173794, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21393822}
2025-03-03 01:13:07 [reviews] INFO: Stopping for res_id: 21393822 as reviews are older than 7 days.
2025-03-03 01:13:10 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21227450&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:13:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20896097&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:13:15 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21240266&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:13:19 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21264546&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:13:21 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21275729&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:13:25 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21131421&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:13:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20907523&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:13:31 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20998125&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:13:35 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20844186&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:13:39 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20660045&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:13:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20880681&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:13:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20667565&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:13:50 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20587336&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:13:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21395028&page=1> (referer: None)
2025-03-03 01:13:54 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21395028, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964379, 'download_latency': 0.744624137878418, 'depth': 0}
2025-03-03 01:13:54 [reviews] INFO: Scraped item: {'review': "the plastic jar is absolutely horrible. I've ordered 5-6 times different items and the jar just doesn't open", 'review_id': 280487958, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21395028}
2025-03-03 01:13:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21395028&page=1>
{'review': "the plastic jar is absolutely horrible. I've ordered 5-6 times different items and the jar just doesn't open", 'review_id': 280487958, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-02-26', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21395028}
2025-03-03 01:13:54 [reviews] INFO: Stopping for res_id: 21395028 as reviews are older than 7 days.
2025-03-03 01:13:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21401321&page=1> (referer: None)
2025-03-03 01:13:58 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '4 Bungalows', 'platform': 'zomato', 'res_id': 21401321, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964384, 'download_latency': 1.0095317363739014, 'depth': 0}
2025-03-03 01:13:58 [reviews] INFO: Scraped item: {'review': 'Half cooked. vegetables', 'review_id': 282276227, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '4 Bungalows', 'platform': 'zomato', 'res_id': 21401321}
2025-03-03 01:13:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21401321&page=1>
{'review': 'Half cooked. vegetables', 'review_id': 282276227, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '4 Bungalows', 'platform': 'zomato', 'res_id': 21401321}
2025-03-03 01:13:58 [reviews] INFO: Scraped item: {'review': 'thank you ', 'review_id': 282267955, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '4 Bungalows', 'platform': 'zomato', 'res_id': 21401321}
2025-03-03 01:13:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21401321&page=1>
{'review': 'thank you ', 'review_id': 282267955, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '4 Bungalows', 'platform': 'zomato', 'res_id': 21401321}
2025-03-03 01:13:58 [reviews] INFO: Scraped item: {'review': 'nice fast delivery 🚚', 'review_id': 282264479, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '4 Bungalows', 'platform': 'zomato', 'res_id': 21401321}
2025-03-03 01:13:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21401321&page=1>
{'review': 'nice fast delivery 🚚', 'review_id': 282264479, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '4 Bungalows', 'platform': 'zomato', 'res_id': 21401321}
2025-03-03 01:13:58 [reviews] INFO: Scraped item: {'review': 'I love the Chinese food here - spices make the flavour lip smacking. The Indian flavoured Hakka noodles and fried rice are my favorite. Always perfect and quality and quantity was superb', 'review_id': 282253083, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '4 Bungalows', 'platform': 'zomato', 'res_id': 21401321}
2025-03-03 01:13:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21401321&page=1>
{'review': 'I love the Chinese food here - spices make the flavour lip smacking. The Indian flavoured Hakka noodles and fried rice are my favorite. Always perfect and quality and quantity was superb', 'review_id': 282253083, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '4 Bungalows', 'platform': 'zomato', 'res_id': 21401321}
2025-03-03 01:13:58 [reviews] INFO: Scraped item: {'review': 'Ordered a butter chicken and wheat rumali rotis from persian darbar. The food came nicely packed and on time. The food was nice and tasty. The taste was awesome and biryani is amazingly good with gulab jamun <br/>everything on point and value of money with full of tummy ', 'review_id': 282251210, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '4 Bungalows', 'platform': 'zomato', 'res_id': 21401321}
2025-03-03 01:13:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21401321&page=1>
{'review': 'Ordered a butter chicken and wheat rumali rotis from persian darbar. The food came nicely packed and on time. The food was nice and tasty. The taste was awesome and biryani is amazingly good with gulab jamun <br/>everything on point and value of money with full of tummy ', 'review_id': 282251210, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '4 Bungalows', 'platform': 'zomato', 'res_id': 21401321}
2025-03-03 01:14:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21432852&page=1> (referer: None)
2025-03-03 01:14:02 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 25, 'brand_name': "Veronica's", 'city': 'Mumbai', 'sub_zone': 'Bandra East', 'platform': 'zomato', 'res_id': 21432852, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964387, 'download_latency': 1.2160470485687256, 'depth': 0}
2025-03-03 01:14:02 [reviews] INFO: Stopping for res_id: 21432852 as reviews are older than 7 days.
2025-03-03 01:14:05 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21227450&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:14:06 [scrapy.extensions.logstats] INFO: Crawled 188 pages (at 4 pages/min), scraped 630 items (at 8 items/min)
2025-03-03 01:14:09 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20896097&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:14:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21240266&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:14:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21264546&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:14:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21275729&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:14:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21131421&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:14:26 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20907523&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:14:30 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20998125&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:14:35 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20844186&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:14:38 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20660045&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:14:43 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20880681&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:14:46 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20667565&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:14:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21462394&page=1> (referer: None)
2025-03-03 01:14:49 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 37, 'brand_name': 'Blue Tokai Coffee Roasters', 'city': 'Bangalore', 'sub_zone': 'Lavelle Road', 'platform': 'zomato', 'res_id': 21462394, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964430, 'download_latency': 1.1479246616363525, 'depth': 0}
2025-03-03 01:14:49 [reviews] INFO: Scraped item: {'review': 'delicious 🍄 sourdough 🥪 sandwich!<br/>not spicy at all', 'review_id': 280376141, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 37, 'brand_name': 'Blue Tokai Coffee Roasters', 'city': 'Bangalore', 'sub_zone': 'Lavelle Road', 'platform': 'zomato', 'res_id': 21462394}
2025-03-03 01:14:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21462394&page=1>
{'review': 'delicious 🍄 sourdough 🥪 sandwich!<br/>not spicy at all', 'review_id': 280376141, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-02-25', 'competitor_id': 37, 'brand_name': 'Blue Tokai Coffee Roasters', 'city': 'Bangalore', 'sub_zone': 'Lavelle Road', 'platform': 'zomato', 'res_id': 21462394}
2025-03-03 01:14:49 [reviews] INFO: Stopping for res_id: 21462394 as reviews are older than 7 days.
2025-03-03 01:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21503794&page=1> (referer: None)
2025-03-03 01:14:52 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964434, 'download_latency': 0.8479881286621094, 'depth': 0}
2025-03-03 01:14:52 [reviews] INFO: Scraped item: {'review': 'Not eatable. This the worst biryani I have ever had.', 'review_id': 282239478, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794}
2025-03-03 01:14:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21503794&page=1>
{'review': 'Not eatable. This the worst biryani I have ever had.', 'review_id': 282239478, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794}
2025-03-03 01:14:52 [reviews] INFO: Scraped item: {'review': 'very bad as only rise available...with 1pice of chicken ', 'review_id': 281642663, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794}
2025-03-03 01:14:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21503794&page=1>
{'review': 'very bad as only rise available...with 1pice of chicken ', 'review_id': 281642663, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794}
2025-03-03 01:14:52 [reviews] INFO: Scraped item: {'review': "Store is just 2 km away and order was supposed to be delivered in 35 mins don't know what tools them 72 mins to deliver the order...quality is compromised now", 'review_id': 281510746, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794}
2025-03-03 01:14:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21503794&page=1>
{'review': "Store is just 2 km away and order was supposed to be delivered in 35 mins don't know what tools them 72 mins to deliver the order...quality is compromised now", 'review_id': 281510746, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794}
2025-03-03 01:14:52 [reviews] INFO: Scraped item: {'review': 'good test ', 'review_id': 281421101, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794}
2025-03-03 01:14:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21503794&page=1>
{'review': 'good test ', 'review_id': 281421101, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794}
2025-03-03 01:14:52 [reviews] INFO: Scraped item: {'review': 'we add salan with the order but received raita', 'review_id': 281414409, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794}
2025-03-03 01:14:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21503794&page=1>
{'review': 'we add salan with the order but received raita', 'review_id': 281414409, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794}
2025-03-03 01:14:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21514302&page=1> (referer: None)
2025-03-03 01:14:56 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 29, 'brand_name': 'abCoffee', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21514302, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964439, 'download_latency': 0.7829532623291016, 'depth': 0}
2025-03-03 01:14:56 [reviews] INFO: Stopping for res_id: 21514302 as reviews are older than 7 days.
2025-03-03 01:14:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21401321&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:15:01 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21227450&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:15:06 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20896097&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:15:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2025-03-03 01:15:06 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108
2025-03-03 01:15:06 [scrapy.extensions.logstats] INFO: Crawled 191 pages (at 3 pages/min), scraped 636 items (at 6 items/min)
2025-03-03 01:15:10 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21240266&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:15:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21264546&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:15:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21275729&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:15:23 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21131421&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:15:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20907523&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:15:31 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20998125&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:15:33 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20844186&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:15:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21528554&page=1> (referer: None)
2025-03-03 01:15:38 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964479, 'download_latency': 2.214625358581543, 'depth': 0}
2025-03-03 01:15:38 [reviews] INFO: Scraped item: {'review': 'i orfered 2 nordic bread. received only one. called paul,and they cant make a eefund.', 'review_id': 282209437, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554}
2025-03-03 01:15:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21528554&page=1>
{'review': 'i orfered 2 nordic bread. received only one. called paul,and they cant make a eefund.', 'review_id': 282209437, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554}
2025-03-03 01:15:38 [reviews] INFO: Scraped item: {'review': 'Cold Food was delivered and it was to difficult to eat', 'review_id': 282153868, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554}
2025-03-03 01:15:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21528554&page=1>
{'review': 'Cold Food was delivered and it was to difficult to eat', 'review_id': 282153868, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554}
2025-03-03 01:15:38 [reviews] INFO: Scraped item: {'review': 'This is my 4th time at PAUL and very impressed with their food and service - would be going very many times over', 'review_id': 281286644, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-02-28', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554}
2025-03-03 01:15:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21528554&page=1>
{'review': 'This is my 4th time at PAUL and very impressed with their food and service - would be going very many times over', 'review_id': 281286644, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-02-28', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554}
2025-03-03 01:15:38 [reviews] INFO: Scraped item: {'review': "The only thing to rave about was the French Onion Soup. We ordered the Garlic Chicken and a burrata pizza and both were so inedible that we didn't even bother to pack them for takeaway. We expected far better portions , quality and raste at the price point they serve at.", 'review_id': 281164509, 'rating': '2', 'review_type': 'DINING', 'review_date': '2025-02-28', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554}
2025-03-03 01:15:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21528554&page=1>
{'review': "The only thing to rave about was the French Onion Soup. We ordered the Garlic Chicken and a burrata pizza and both were so inedible that we didn't even bother to pack them for takeaway. We expected far better portions , quality and raste at the price point they serve at.", 'review_id': 281164509, 'rating': '2', 'review_type': 'DINING', 'review_date': '2025-02-28', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554}
2025-03-03 01:15:38 [reviews] INFO: Scraped item: {'review': 'Not worth the hype at all service was really terrible food was ok !', 'review_id': 281121599, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-02-28', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554}
2025-03-03 01:15:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21528554&page=1>
{'review': 'Not worth the hype at all service was really terrible food was ok !', 'review_id': 281121599, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-02-28', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554}
2025-03-03 01:15:40 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20880681&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:15:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21565814&page=1> (referer: None)
2025-03-03 01:15:44 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 33, 'brand_name': 'Nandan Coffee', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21565814, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964486, 'download_latency': 0.8250935077667236, 'depth': 0}
2025-03-03 01:15:44 [scrapy.core.scraper] ERROR: Spider error processing <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21565814&page=1> (referer: None)
Traceback (most recent call last):
  File "/home/ubuntu/restaverse_spiders/venv/lib/python3.10/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
  File "/home/ubuntu/restaverse_spiders/venv/lib/python3.10/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
  File "/home/ubuntu/restaverse_spiders/venv/lib/python3.10/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
  File "/home/ubuntu/restaverse_spiders/venv/lib/python3.10/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/restaverse_spiders/venv/lib/python3.10/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
  File "/home/ubuntu/restaverse_spiders/venv/lib/python3.10/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/restaverse_spiders/venv/lib/python3.10/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
  File "/home/ubuntu/restaverse_spiders/venv/lib/python3.10/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/restaverse_spiders/venv/lib/python3.10/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
  File "/home/ubuntu/restaverse_spiders/venv/lib/python3.10/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/restaverse_spiders/eggs/zomato_competiton_analysis/1739782236.egg/zomato_competiton_analysis/spiders/reviews.py", line 81, in parse_reviews
    for review_id, review_data in reviews.items():
AttributeError: 'list' object has no attribute 'items'
2025-03-03 01:15:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21568377&page=1> (referer: None)
2025-03-03 01:15:48 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 21568377, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964490, 'download_latency': 1.0381300449371338, 'depth': 0}
2025-03-03 01:15:48 [reviews] INFO: Scraped item: {'review': 'Koyla chicken is not cooked .., it looks raw', 'review_id': 281789625, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 21568377}
2025-03-03 01:15:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21568377&page=1>
{'review': 'Koyla chicken is not cooked .., it looks raw', 'review_id': 281789625, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 21568377}
2025-03-03 01:15:48 [reviews] INFO: Scraped item: {'review': 'Delicious', 'review_id': 281627574, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 21568377}
2025-03-03 01:15:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21568377&page=1>
{'review': 'Delicious', 'review_id': 281627574, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-02', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 21568377}
2025-03-03 01:15:48 [reviews] INFO: Scraped item: {'review': 'it take more than 2 hours .. and charge more money like night charge bez off it ... very bad experience ', 'review_id': 281489971, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 21568377}
2025-03-03 01:15:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21568377&page=1>
{'review': 'it take more than 2 hours .. and charge more money like night charge bez off it ... very bad experience ', 'review_id': 281489971, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-01', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 21568377}
2025-03-03 01:15:48 [reviews] INFO: Scraped item: {'review': '', 'review_id': 281251877, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 21568377}
2025-03-03 01:15:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21568377&page=1>
{'review': '', 'review_id': 281251877, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-28', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 21568377}
2025-03-03 01:15:48 [reviews] INFO: Scraped item: {'review': '', 'review_id': 280981663, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 21568377}
2025-03-03 01:15:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21568377&page=1>
{'review': '', 'review_id': 280981663, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-02-27', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 21568377}
2025-03-03 01:15:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21575164&page=1> (referer: None)
2025-03-03 01:15:53 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 27, 'brand_name': 'Grey Soul Coffee Roasters', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 21575164, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1740964493, 'download_latency': 1.0600337982177734, 'depth': 0}
2025-03-03 01:15:53 [reviews] INFO: Stopping for res_id: 21575164 as reviews are older than 7 days.
2025-03-03 01:15:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21503794&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:15:56 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21401321&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:16:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21227450&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:16:02 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20896097&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:16:05 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21240266&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:16:06 [scrapy.extensions.logstats] INFO: Crawled 195 pages (at 4 pages/min), scraped 646 items (at 10 items/min)
2025-03-03 01:16:09 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21264546&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:16:13 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21275729&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:16:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21131421&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:16:20 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20907523&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:16:24 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20998125&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:16:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21528554&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:16:31 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21568377&page=2> (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:16:34 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21503794&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:16:38 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21401321&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:16:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21227450&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:16:45 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21240266&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:16:48 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21264546&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:16:52 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21275729&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:16:55 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21131421&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:16:59 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21528554&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:17:03 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21568377&page=2> (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:17:06 [scrapy.extensions.logstats] INFO: Crawled 195 pages (at 0 pages/min), scraped 646 items (at 0 items/min)
2025-03-03 01:17:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21503794&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:17:10 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21401321&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:17:14 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21227450&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:17:18 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21240266&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:17:21 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21264546&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:17:25 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21275729&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:17:29 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21528554&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:17:34 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21568377&page=2> (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:17:38 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21503794&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:17:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21401321&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:17:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21528554&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:17:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21568377&page=2> (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:17:53 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21503794&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:17:57 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21401321&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:18:01 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21528554&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:18:03 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21568377&page=2> (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:18:06 [scrapy.extensions.logstats] INFO: Crawled 195 pages (at 0 pages/min), scraped 646 items (at 0 items/min)
2025-03-03 01:18:08 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21503794&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:18:12 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21528554&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:18:14 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21568377&page=2> (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}]
2025-03-03 01:18:14 [scrapy.core.engine] INFO: Closing spider (finished)
2025-03-03 01:18:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): cron.restaverse.com:443
2025-03-03 01:18:14 [urllib3.connectionpool] DEBUG: https://cron.restaverse.com:443 "POST /insert_data/ HTTP/11" 201 112
2025-03-03 01:18:14 [reviews] INFO: Data posted successfully.
2025-03-03 01:18:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2025-03-03 01:18:15 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108
2025-03-03 01:18:15 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/exception_count': 594,
 'downloader/exception_type_count/scrapy.core.downloader.handlers.http11.TunnelError': 594,
 'downloader/request_bytes': 710967,
 'downloader/request_count': 789,
 'downloader/request_method_count/GET': 789,
 'downloader/response_bytes': 990274,
 'downloader/response_count': 195,
 'downloader/response_status_count/200': 194,
 'downloader/response_status_count/400': 1,
 'elapsed_time_seconds': 2888.048277,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2025, 3, 3, 1, 18, 14, 476440, tzinfo=datetime.timezone.utc),
 'httpcompression/response_bytes': 1825119,
 'httpcompression/response_count': 194,
 'item_scraped_count': 646,
 'items_per_minute': None,
 'log_count/DEBUG': 1411,
 'log_count/ERROR': 104,
 'log_count/INFO': 993,
 'memusage/max': 78315520,
 'memusage/startup': 65290240,
 'request_depth_max': 1,
 'response_received_count': 195,
 'responses_per_minute': None,
 'retry/count': 495,
 'retry/max_reached': 99,
 'retry/reason_count/scrapy.core.downloader.handlers.http11.TunnelError': 495,
 'scheduler/dequeued': 789,
 'scheduler/dequeued/memory': 789,
 'scheduler/enqueued': 789,
 'scheduler/enqueued/memory': 789,
 'spider_exceptions/AttributeError': 1,
 'start_time': datetime.datetime(2025, 3, 3, 0, 30, 6, 428163, tzinfo=datetime.timezone.utc)}
2025-03-03 01:18:15 [scrapy.core.engine] INFO: Spider closed (finished)