2025-03-10 00:30:06 [scrapy.utils.log] INFO: Scrapy 2.12.0 started (bot: zomato_competiton_analysis) 2025-03-10 00:30:06 [scrapy.utils.log] INFO: Versions: lxml 5.3.0.0, libxml2 2.12.9, cssselect 1.2.0, parsel 1.9.1, w3lib 2.2.1, Twisted 24.11.0, Python 3.10.12 (main, Feb 4 2025, 14:57:36) [GCC 11.4.0], pyOpenSSL 24.3.0 (OpenSSL 3.4.0 22 Oct 2024), cryptography 44.0.0, Platform Linux-6.8.0-1015-aws-aarch64-with-glibc2.35 2025-03-10 00:30:06 [scrapy.addons] INFO: Enabled addons: [] 2025-03-10 00:30:06 [asyncio] DEBUG: Using selector: EpollSelector 2025-03-10 00:30:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor 2025-03-10 00:30:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop 2025-03-10 00:30:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor 2025-03-10 00:30:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop 2025-03-10 00:30:06 [scrapy.extensions.telnet] INFO: Telnet Password: b48b3feee8752f1b 2025-03-10 00:30:06 [scrapy.middleware] INFO: Enabled extensions: ['scrapy.extensions.corestats.CoreStats', 'scrapy.extensions.telnet.TelnetConsole', 'scrapy.extensions.memusage.MemoryUsage', 'scrapy.extensions.logstats.LogStats', 'scrapeops_scrapy.extension.ScrapeOpsMonitor'] 2025-03-10 00:30:06 [scrapy.crawler] INFO: Overridden settings: {'BOT_NAME': 'zomato_competiton_analysis', 'DOWNLOAD_DELAY': 3, 'DOWNLOAD_TIMEOUT': 30, 'FEED_EXPORT_ENCODING': 'utf-8', 'LOG_FILE': '/home/ubuntu/restaverse_spiders/logs/zomato_competiton_analysis/reviews/zomato ' 'competitor analysis reviws_2025-03-10T00_30_02.log', 'NEWSPIDER_MODULE': 'zomato_competiton_analysis.spiders', 'RETRY_HTTP_CODES': [500, 502, 503, 504, 408], 'RETRY_TIMES': 5, 'SPIDER_MODULES': ['zomato_competiton_analysis.spiders'], 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor'} 2025-03-10 00:30:06 [scrapy.middleware] INFO: Enabled downloader middlewares: ['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware', 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware', 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware', 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware', 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware', 'scrapeops_scrapy.middleware.retry.RetryMiddleware', 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware', 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware', 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware', 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware', 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware', 'scrapy.downloadermiddlewares.stats.DownloaderStats'] 2025-03-10 00:30:06 [scrapy.middleware] INFO: Enabled spider middlewares: ['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware', 'scrapy.spidermiddlewares.referer.RefererMiddleware', 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware', 'scrapy.spidermiddlewares.depth.DepthMiddleware'] 2025-03-10 00:30:06 [scrapy.middleware] INFO: Enabled item pipelines: ['zomato_competiton_analysis.pipelines.ZomatoCompetionAnalysisPipeline'] 2025-03-10 00:30:06 [scrapy.core.engine] INFO: Spider opened 2025-03-10 00:30:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-03-10 00:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-10 00:30:07 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/setup/ HTTP/11" 200 None 2025-03-10 00:30:07 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024 2025-03-10 00:30:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): cron.restaverse.com:443 2025-03-10 00:30:09 [urllib3.connectionpool] DEBUG: https://cron.restaverse.com:443 "POST /api/db_services/fetch-query HTTP/11" 200 28263 2025-03-10 00:30:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-10 00:30:10 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/normalizer/proxy_port/?job_id=3499256 HTTP/11" 200 None 2025-03-10 00:30:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-10 00:30:10 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/normalizer/domain/?domain=zomato.com HTTP/11" 200 241 2025-03-10 00:30:12 [scrapy.core.engine] DEBUG: Crawled (400) (referer: None) 2025-03-10 00:30:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:30:15 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741566611, 'download_latency': 0.7048892974853516, 'depth': 0} 2025-03-10 00:30:15 [reviews] INFO: Scraped item: {'review': "Pan fried noodles in schezewan sauce was good as usual, Chicken dim sum's could have been more juicy, was a bit dry! Always love the food at Mamagato!", 'review_id': 284585001, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947} 2025-03-10 00:30:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=947&page=1> {'review': "Pan fried noodles in schezewan sauce was good as usual, Chicken dim sum's could have been more juicy, was a bit dry! Always love the food at Mamagato!", 'review_id': 284585001, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947} 2025-03-10 00:30:15 [reviews] INFO: Scraped item: {'review': 'Parag Lama Helped us with services', 'review_id': 284497129, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947} 2025-03-10 00:30:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=947&page=1> {'review': 'Parag Lama Helped us with services', 'review_id': 284497129, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947} 2025-03-10 00:30:15 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283731271, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947} 2025-03-10 00:30:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=947&page=1> {'review': '', 'review_id': 283731271, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947} 2025-03-10 00:30:15 [reviews] INFO: Scraped item: {'review': 'Parag lama was very helpful and great with his service . Would love to come here again an again', 'review_id': 283567009, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947} 2025-03-10 00:30:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=947&page=1> {'review': 'Parag lama was very helpful and great with his service . Would love to come here again an again', 'review_id': 283567009, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947} 2025-03-10 00:30:15 [reviews] INFO: Scraped item: {'review': 'Parag was very helpful and gave an amazing service', 'review_id': 283373460, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947} 2025-03-10 00:30:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=947&page=1> {'review': 'Parag was very helpful and gave an amazing service', 'review_id': 283373460, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 54, 'brand_name': 'Mamagoto', 'city': 'New Delhi', 'sub_zone': 'Select Citywalk Mall (Saket)', 'platform': 'zomato', 'res_id': 947} 2025-03-10 00:30:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:30:19 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741566611, 'download_latency': 0.8832693099975586, 'depth': 0} 2025-03-10 00:30:19 [reviews] INFO: Scraped item: {'review': '๐Ÿ‘', 'review_id': 284628980, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835} 2025-03-10 00:30:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32835&page=1> {'review': '๐Ÿ‘', 'review_id': 284628980, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835} 2025-03-10 00:30:19 [reviews] INFO: Scraped item: {'review': 'The Iftar delivery was quick and reliable! The food was fresh with generous portions, and the hygienic packaging made it even better', 'review_id': 284571929, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835} 2025-03-10 00:30:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32835&page=1> {'review': 'The Iftar delivery was quick and reliable! The food was fresh with generous portions, and the hygienic packaging made it even better', 'review_id': 284571929, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835} 2025-03-10 00:30:19 [reviews] INFO: Scraped item: {'review': 'no taste, waste of money
ekdum bekar
had to throw away the dish', 'review_id': 284562005, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835} 2025-03-10 00:30:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32835&page=1> {'review': 'no taste, waste of money
ekdum bekar
had to throw away the dish', 'review_id': 284562005, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835} 2025-03-10 00:30:19 [reviews] INFO: Scraped item: {'review': 'Tried the Ramadan delivery, and it was a smooth experience! The food was delicious and arrived hot and fresh, making Iftar truly enjoyable.', 'review_id': 284519240, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835} 2025-03-10 00:30:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32835&page=1> {'review': 'Tried the Ramadan delivery, and it was a smooth experience! The food was delicious and arrived hot and fresh, making Iftar truly enjoyable.', 'review_id': 284519240, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835} 2025-03-10 00:30:19 [reviews] INFO: Scraped item: {'review': 'Tried the Ramadan delivery, and it was a smooth experience! The food was delicious and arrived hot and fresh, making Iftar truly enjoyable.', 'review_id': 284439421, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835} 2025-03-10 00:30:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32835&page=1> {'review': 'Tried the Ramadan delivery, and it was a smooth experience! The food was delicious and arrived hot and fresh, making Iftar truly enjoyable.', 'review_id': 284439421, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 32835} 2025-03-10 00:30:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-10 00:30:21 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-10 00:30:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:30:23 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 32971, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741566611, 'download_latency': 0.6977760791778564, 'depth': 0} 2025-03-10 00:30:23 [reviews] INFO: Scraped item: {'review': 'Both rotis were horrible and inedible', 'review_id': 284552033, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 32971} 2025-03-10 00:30:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32971&page=1> {'review': 'Both rotis were horrible and inedible', 'review_id': 284552033, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 32971} 2025-03-10 00:30:23 [reviews] INFO: Scraped item: {'review': 'there is no nalli in rogan ', 'review_id': 284465006, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 32971} 2025-03-10 00:30:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32971&page=1> {'review': 'there is no nalli in rogan ', 'review_id': 284465006, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 32971} 2025-03-10 00:30:23 [reviews] INFO: Scraped item: {'review': 'Food quality is good, Service by Ishtiyak is very good with polite attitude', 'review_id': 284316436, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 32971} 2025-03-10 00:30:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32971&page=1> {'review': 'Food quality is good, Service by Ishtiyak is very good with polite attitude', 'review_id': 284316436, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 32971} 2025-03-10 00:30:23 [reviews] INFO: Scraped item: {'review': 'dilip was excellent ', 'review_id': 283921982, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 32971} 2025-03-10 00:30:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32971&page=1> {'review': 'dilip was excellent ', 'review_id': 283921982, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 32971} 2025-03-10 00:30:23 [reviews] INFO: Scraped item: {'review': 'The food as usual is excellent! The best paneer masala, Roomali Roti and Malai Kofta !! We visited here on Womenโ€™s Day and got a lovely surprise too !! ๐Ÿ’•
Fantastic service by Istiyak and Vijay as well !!', 'review_id': 283894363, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 32971} 2025-03-10 00:30:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=32971&page=1> {'review': 'The food as usual is excellent! The best paneer masala, Roomali Roti and Malai Kofta !! We visited here on Womenโ€™s Day and got a lovely surprise too !! ๐Ÿ’•
Fantastic service by Istiyak and Vijay as well !!', 'review_id': 283894363, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 0, 'brand_name': 'Copper chimney ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 32971} 2025-03-10 00:30:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:30:27 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741566611, 'download_latency': 0.8479127883911133, 'depth': 0} 2025-03-10 00:30:27 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284563104, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052} 2025-03-10 00:30:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34052&page=1> {'review': '', 'review_id': 284563104, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052} 2025-03-10 00:30:27 [reviews] INFO: Scraped item: {'review': 'spicy and tasty ', 'review_id': 284553663, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052} 2025-03-10 00:30:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34052&page=1> {'review': 'spicy and tasty ', 'review_id': 284553663, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052} 2025-03-10 00:30:27 [reviews] INFO: Scraped item: {'review': 'awesome ', 'review_id': 284486358, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052} 2025-03-10 00:30:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34052&page=1> {'review': 'awesome ', 'review_id': 284486358, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052} 2025-03-10 00:30:27 [reviews] INFO: Scraped item: {'review': 'delivery was not up to the mark the guy was fit and fine but still decided to lie about his health and i had to get down to the ground floor to receive the parcel ', 'review_id': 284384632, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052} 2025-03-10 00:30:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34052&page=1> {'review': 'delivery was not up to the mark the guy was fit and fine but still decided to lie about his health and i had to get down to the ground floor to receive the parcel ', 'review_id': 284384632, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052} 2025-03-10 00:30:27 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284193462, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052} 2025-03-10 00:30:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34052&page=1> {'review': '', 'review_id': 284193462, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 7, 'brand_name': 'Cafe Safar', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 34052} 2025-03-10 00:30:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:30:31 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741566611, 'download_latency': 0.8457720279693604, 'depth': 0} 2025-03-10 00:30:31 [reviews] INFO: Scraped item: {'review': 'It tasted good .Thanks', 'review_id': 284538924, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157} 2025-03-10 00:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34157&page=1> {'review': 'It tasted good .Thanks', 'review_id': 284538924, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157} 2025-03-10 00:30:31 [reviews] INFO: Scraped item: {'review': 'there is no taste and salt ..', 'review_id': 283899095, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157} 2025-03-10 00:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34157&page=1> {'review': 'there is no taste and salt ..', 'review_id': 283899095, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157} 2025-03-10 00:30:31 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283741389, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157} 2025-03-10 00:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34157&page=1> {'review': '', 'review_id': 283741389, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157} 2025-03-10 00:30:31 [reviews] INFO: Scraped item: {'review': '', 'review_id': 282887827, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157} 2025-03-10 00:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34157&page=1> {'review': '', 'review_id': 282887827, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157} 2025-03-10 00:30:31 [reviews] INFO: Scraped item: {'review': "Noodles is so much salty. Don't like the taste of noodles", 'review_id': 282807083, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157} 2025-03-10 00:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34157&page=1> {'review': "Noodles is so much salty. Don't like the taste of noodles", 'review_id': 282807083, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Pali Hill', 'platform': 'zomato', 'res_id': 34157} 2025-03-10 00:30:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:30:34 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741566611, 'download_latency': 0.7286620140075684, 'depth': 0} 2025-03-10 00:30:34 [reviews] INFO: Scraped item: {'review': 'Tried Persian Darbarโ€™s Ramadan offers, and the food was amazing! The dishes were delicious and arrived hot and fresh, making Iftar a flavourful and satisfying experience', 'review_id': 284619378, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269} 2025-03-10 00:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34269&page=1> {'review': 'Tried Persian Darbarโ€™s Ramadan offers, and the food was amazing! The dishes were delicious and arrived hot and fresh, making Iftar a flavourful and satisfying experience', 'review_id': 284619378, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269} 2025-03-10 00:30:34 [reviews] INFO: Scraped item: {'review': 'there was too much threads in the box in comparison with number of chicken pieces.
smaller amount of threads and plate would do better I think', 'review_id': 284604424, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269} 2025-03-10 00:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34269&page=1> {'review': 'there was too much threads in the box in comparison with number of chicken pieces.
smaller amount of threads and plate would do better I think', 'review_id': 284604424, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269} 2025-03-10 00:30:34 [reviews] INFO: Scraped item: {'review': 'Chicken was not good. Felt like chewing a rubber. Gravy was also very tangy. ', 'review_id': 284565307, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269} 2025-03-10 00:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34269&page=1> {'review': 'Chicken was not good. Felt like chewing a rubber. Gravy was also very tangy. ', 'review_id': 284565307, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269} 2025-03-10 00:30:34 [reviews] INFO: Scraped item: {'review': 'Ordered during Ramadan, and the service was top-notch! The food was fresh with a perfect balance of spices, and the delivery met expectations perfectly.', 'review_id': 284501139, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269} 2025-03-10 00:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34269&page=1> {'review': 'Ordered during Ramadan, and the service was top-notch! The food was fresh with a perfect balance of spices, and the delivery met expectations perfectly.', 'review_id': 284501139, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269} 2025-03-10 00:30:34 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284468150, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269} 2025-03-10 00:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34269&page=1> {'review': '', 'review_id': 284468150, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 34269} 2025-03-10 00:30:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-10 00:30:36 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-10 00:30:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:30:38 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 0, 'brand_name': 'Kailash Parbat ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 34410, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741566611, 'download_latency': 0.7969005107879639, 'depth': 0} 2025-03-10 00:30:38 [reviews] INFO: Scraped item: {'review': 'There was no malai in the lassi.', 'review_id': 284440604, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 0, 'brand_name': 'Kailash Parbat ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 34410} 2025-03-10 00:30:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34410&page=1> {'review': 'There was no malai in the lassi.', 'review_id': 284440604, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 0, 'brand_name': 'Kailash Parbat ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 34410} 2025-03-10 00:30:38 [reviews] INFO: Scraped item: {'review': 'lovely CAN BE BETTER! MORE SEV AND RABRI ! WELL MADE!', 'review_id': 283084144, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 0, 'brand_name': 'Kailash Parbat ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 34410} 2025-03-10 00:30:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34410&page=1> {'review': 'lovely CAN BE BETTER! MORE SEV AND RABRI ! WELL MADE!', 'review_id': 283084144, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 0, 'brand_name': 'Kailash Parbat ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 34410} 2025-03-10 00:30:38 [reviews] INFO: Scraped item: {'review': 'VER NICE WELL MADE WOULD LIKE THE KULFI TO BE MORE MILKY BUT OVERALL GOOD SAMOSA WAS GOOD MASALA DELICIOUS! ', 'review_id': 282911065, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 0, 'brand_name': 'Kailash Parbat ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 34410} 2025-03-10 00:30:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34410&page=1> {'review': 'VER NICE WELL MADE WOULD LIKE THE KULFI TO BE MORE MILKY BUT OVERALL GOOD SAMOSA WAS GOOD MASALA DELICIOUS! ', 'review_id': 282911065, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 0, 'brand_name': 'Kailash Parbat ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 34410} 2025-03-10 00:30:38 [reviews] INFO: Scraped item: {'review': 'this samosa and Lassi never disappoints me..my absolutely favorite spot since childhood ', 'review_id': 282868133, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 0, 'brand_name': 'Kailash Parbat ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 34410} 2025-03-10 00:30:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34410&page=1> {'review': 'this samosa and Lassi never disappoints me..my absolutely favorite spot since childhood ', 'review_id': 282868133, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 0, 'brand_name': 'Kailash Parbat ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 34410} 2025-03-10 00:30:38 [reviews] INFO: Scraped item: {'review': "plz add pickel anions with this dish.i didn't get in the box.", 'review_id': 282640930, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 0, 'brand_name': 'Kailash Parbat ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 34410} 2025-03-10 00:30:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34410&page=1> {'review': "plz add pickel anions with this dish.i didn't get in the box.", 'review_id': 282640930, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 0, 'brand_name': 'Kailash Parbat ', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 34410} 2025-03-10 00:30:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:30:40 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741566611, 'download_latency': 0.8184497356414795, 'depth': 0} 2025-03-10 00:30:40 [reviews] INFO: Scraped item: {'review': 'The lollypop pieces are really small and not worth the price. very disappointed ', 'review_id': 284318599, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777} 2025-03-10 00:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34777&page=1> {'review': 'The lollypop pieces are really small and not worth the price. very disappointed ', 'review_id': 284318599, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777} 2025-03-10 00:30:40 [reviews] INFO: Scraped item: {'review': 'The Fried rice was like pot rice and the Manchuria was salty.', 'review_id': 284145078, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777} 2025-03-10 00:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34777&page=1> {'review': 'The Fried rice was like pot rice and the Manchuria was salty.', 'review_id': 284145078, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777} 2025-03-10 00:30:40 [reviews] INFO: Scraped item: {'review': 'Hopeless food and hopeless peopleโ€ฆ I ordered veg fried rice and veg noodles, the noodles were terribly spicy that one could not eat. I was a regular customer on uncles kitchen. I called the restaurant twice, first time they heard and kept the phone on the side and the second time, one guy very rudely said complain on Zomato. They were least bothered about customers complain. I will never order again for uncles kitchen', 'review_id': 284105562, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777} 2025-03-10 00:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34777&page=1> {'review': 'Hopeless food and hopeless peopleโ€ฆ I ordered veg fried rice and veg noodles, the noodles were terribly spicy that one could not eat. I was a regular customer on uncles kitchen. I called the restaurant twice, first time they heard and kept the phone on the side and the second time, one guy very rudely said complain on Zomato. They were least bothered about customers complain. I will never order again for uncles kitchen', 'review_id': 284105562, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777} 2025-03-10 00:30:40 [reviews] INFO: Scraped item: {'review': "It's no more the old Uncle's Kitchen.
Pathetic food to be Frank.
Schezwan Chicken Fried rice was bland.
and Chicken Lollipop was the bestsellers so thought of giving it a try, it was completed drenched in oil and not properly cooked.
Think twice before you order from Uncle's Kitchen.", 'review_id': 284089893, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777} 2025-03-10 00:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34777&page=1> {'review': "It's no more the old Uncle's Kitchen.
Pathetic food to be Frank.
Schezwan Chicken Fried rice was bland.
and Chicken Lollipop was the bestsellers so thought of giving it a try, it was completed drenched in oil and not properly cooked.
Think twice before you order from Uncle's Kitchen.", 'review_id': 284089893, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777} 2025-03-10 00:30:40 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284013035, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777} 2025-03-10 00:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34777&page=1> {'review': '', 'review_id': 284013035, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 62, 'brand_name': "Uncle's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 34777} 2025-03-10 00:30:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:30:44 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 73, 'brand_name': 'Fire Bowl', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 34810, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741566611, 'download_latency': 0.702948808670044, 'depth': 0} 2025-03-10 00:30:44 [reviews] INFO: Scraped item: {'review': "utterly nonsense dish, I have had oyster sauce chicken in many places and it's usually prepared in black sauce and is not very spicy but this is totally different made in red sauce like shezwan chicken and extremely spicy don't order", 'review_id': 284080111, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 73, 'brand_name': 'Fire Bowl', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 34810} 2025-03-10 00:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34810&page=1> {'review': "utterly nonsense dish, I have had oyster sauce chicken in many places and it's usually prepared in black sauce and is not very spicy but this is totally different made in red sauce like shezwan chicken and extremely spicy don't order", 'review_id': 284080111, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 73, 'brand_name': 'Fire Bowl', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 34810} 2025-03-10 00:30:44 [reviews] INFO: Scraped item: {'review': 'Bad stale chicken n prawns!', 'review_id': 283436442, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 73, 'brand_name': 'Fire Bowl', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 34810} 2025-03-10 00:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34810&page=1> {'review': 'Bad stale chicken n prawns!', 'review_id': 283436442, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 73, 'brand_name': 'Fire Bowl', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 34810} 2025-03-10 00:30:44 [reviews] INFO: Scraped item: {'review': '', 'review_id': 282739343, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 73, 'brand_name': 'Fire Bowl', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 34810} 2025-03-10 00:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34810&page=1> {'review': '', 'review_id': 282739343, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 73, 'brand_name': 'Fire Bowl', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 34810} 2025-03-10 00:30:44 [reviews] INFO: Stopping for res_id: 34810 as reviews are older than 7 days. 2025-03-10 00:30:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:30:49 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741566611, 'download_latency': 0.7690730094909668, 'depth': 0} 2025-03-10 00:30:49 [reviews] INFO: Scraped item: {'review': 'The mutton biryani was amazing. Proper pieces of mutton and my special request for more of white rice was taken care of.', 'review_id': 284613910, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844} 2025-03-10 00:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34844&page=1> {'review': 'The mutton biryani was amazing. Proper pieces of mutton and my special request for more of white rice was taken care of.', 'review_id': 284613910, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844} 2025-03-10 00:30:49 [reviews] INFO: Scraped item: {'review': "the worst restaurant . ordered egg bhurji but got delivered egg afgani. happened to me twice. won't order from this restaurant again", 'review_id': 284497410, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844} 2025-03-10 00:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34844&page=1> {'review': "the worst restaurant . ordered egg bhurji but got delivered egg afgani. happened to me twice. won't order from this restaurant again", 'review_id': 284497410, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844} 2025-03-10 00:30:49 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284286475, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844} 2025-03-10 00:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34844&page=1> {'review': '', 'review_id': 284286475, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844} 2025-03-10 00:30:49 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283941543, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844} 2025-03-10 00:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34844&page=1> {'review': '', 'review_id': 283941543, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844} 2025-03-10 00:30:49 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283778005, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844} 2025-03-10 00:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=34844&page=1> {'review': '', 'review_id': 283778005, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 6, 'brand_name': "Yasin's Food Inn", 'city': 'Mumbai', 'sub_zone': 'Andheri ', 'platform': 'zomato', 'res_id': 34844} 2025-03-10 00:30:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-10 00:30:51 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-10 00:30:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:30:52 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 0, 'brand_name': 'New yorker', 'city': 'Mumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 36164, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741566611, 'download_latency': 0.6997792720794678, 'depth': 0} 2025-03-10 00:30:52 [reviews] INFO: Scraped item: {'review': 'very poor quality food for such a high price. very disappointed. the soup was sugary sweet. the cheese on the pizza seemed very poor quality (cheewe and rubbery) pizza lacked flavour. felt like the sweet soup was the pizza sauce. very poor quality. will never order nor recommend this restaurant to anyone ever. ', 'review_id': 284327132, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 0, 'brand_name': 'New yorker', 'city': 'Mumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 36164} 2025-03-10 00:30:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36164&page=1> {'review': 'very poor quality food for such a high price. very disappointed. the soup was sugary sweet. the cheese on the pizza seemed very poor quality (cheewe and rubbery) pizza lacked flavour. felt like the sweet soup was the pizza sauce. very poor quality. will never order nor recommend this restaurant to anyone ever. ', 'review_id': 284327132, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 0, 'brand_name': 'New yorker', 'city': 'Mumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 36164} 2025-03-10 00:30:52 [reviews] INFO: Stopping for res_id: 36164 as reviews are older than 7 days. 2025-03-10 00:30:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:30:57 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 61, 'brand_name': "Mom's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 36226, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741566611, 'download_latency': 0.7127597332000732, 'depth': 0} 2025-03-10 00:30:57 [reviews] INFO: Scraped item: {'review': 'Rice was not good in taste', 'review_id': 282546418, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 61, 'brand_name': "Mom's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 36226} 2025-03-10 00:30:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36226&page=1> {'review': 'Rice was not good in taste', 'review_id': 282546418, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 61, 'brand_name': "Mom's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 36226} 2025-03-10 00:30:57 [reviews] INFO: Stopping for res_id: 36226 as reviews are older than 7 days. 2025-03-10 00:31:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:31:00 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741566611, 'download_latency': 0.8335671424865723, 'depth': 0} 2025-03-10 00:31:00 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283940760, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291} 2025-03-10 00:31:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36291&page=1> {'review': '', 'review_id': 283940760, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291} 2025-03-10 00:31:00 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283602061, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291} 2025-03-10 00:31:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36291&page=1> {'review': '', 'review_id': 283602061, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291} 2025-03-10 00:31:00 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283249018, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291} 2025-03-10 00:31:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36291&page=1> {'review': '', 'review_id': 283249018, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291} 2025-03-10 00:31:00 [reviews] INFO: Scraped item: {'review': '', 'review_id': 282756156, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291} 2025-03-10 00:31:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=36291&page=1> {'review': '', 'review_id': 282756156, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 0, 'brand_name': 'Ovenfresh ', 'city': 'Mumbai', 'sub_zone': 'Dadar', 'platform': 'zomato', 'res_id': 36291} 2025-03-10 00:31:00 [reviews] INFO: Stopping for res_id: 36291 as reviews are older than 7 days. 2025-03-10 00:31:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:31:04 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 9, 'brand_name': 'Status', 'city': 'Mumbai', 'sub_zone': 'Nariman Point', 'platform': 'zomato', 'res_id': 37459, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741566611, 'download_latency': 0.702406644821167, 'depth': 0} 2025-03-10 00:31:04 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284317445, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 9, 'brand_name': 'Status', 'city': 'Mumbai', 'sub_zone': 'Nariman Point', 'platform': 'zomato', 'res_id': 37459} 2025-03-10 00:31:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37459&page=1> {'review': '', 'review_id': 284317445, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 9, 'brand_name': 'Status', 'city': 'Mumbai', 'sub_zone': 'Nariman Point', 'platform': 'zomato', 'res_id': 37459} 2025-03-10 00:31:04 [reviews] INFO: Scraped item: {'review': 'Too spicy despite requesting', 'review_id': 283250882, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 9, 'brand_name': 'Status', 'city': 'Mumbai', 'sub_zone': 'Nariman Point', 'platform': 'zomato', 'res_id': 37459} 2025-03-10 00:31:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37459&page=1> {'review': 'Too spicy despite requesting', 'review_id': 283250882, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 9, 'brand_name': 'Status', 'city': 'Mumbai', 'sub_zone': 'Nariman Point', 'platform': 'zomato', 'res_id': 37459} 2025-03-10 00:31:04 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283212857, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 9, 'brand_name': 'Status', 'city': 'Mumbai', 'sub_zone': 'Nariman Point', 'platform': 'zomato', 'res_id': 37459} 2025-03-10 00:31:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37459&page=1> {'review': '', 'review_id': 283212857, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 9, 'brand_name': 'Status', 'city': 'Mumbai', 'sub_zone': 'Nariman Point', 'platform': 'zomato', 'res_id': 37459} 2025-03-10 00:31:04 [reviews] INFO: Scraped item: {'review': "The food is the worst I've eaten in recent times! Terrible paneer chilli - had an after taste and was blubbery, not dry as promised. This Chinese dish was served with green chutney! Who does that?! Dal fry (urad dal) was not tasty at all - very unimpressive. 3 waiters serving us. why? we had 1/2 manchow soup, paneer chilli, dal fry and steamed rice (last 3 items we just couldn't eat).. bill was Rs. 1344. what do you think? ", 'review_id': 283117824, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-06', 'competitor_id': 9, 'brand_name': 'Status', 'city': 'Mumbai', 'sub_zone': 'Nariman Point', 'platform': 'zomato', 'res_id': 37459} 2025-03-10 00:31:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37459&page=1> {'review': "The food is the worst I've eaten in recent times! Terrible paneer chilli - had an after taste and was blubbery, not dry as promised. This Chinese dish was served with green chutney! Who does that?! Dal fry (urad dal) was not tasty at all - very unimpressive. 3 waiters serving us. why? we had 1/2 manchow soup, paneer chilli, dal fry and steamed rice (last 3 items we just couldn't eat).. bill was Rs. 1344. what do you think? ", 'review_id': 283117824, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-06', 'competitor_id': 9, 'brand_name': 'Status', 'city': 'Mumbai', 'sub_zone': 'Nariman Point', 'platform': 'zomato', 'res_id': 37459} 2025-03-10 00:31:04 [reviews] INFO: Stopping for res_id: 37459 as reviews are older than 7 days. 2025-03-10 00:31:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-10 00:31:06 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-10 00:31:06 [scrapy.extensions.logstats] INFO: Crawled 15 pages (at 15 pages/min), scraped 58 items (at 58 items/min) 2025-03-10 00:31:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:31:07 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741566611, 'download_latency': 0.7197415828704834, 'depth': 0} 2025-03-10 00:31:07 [reviews] INFO: Scraped item: {'review': 'Paratha was raw', 'review_id': 284380913, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679} 2025-03-10 00:31:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37679&page=1> {'review': 'Paratha was raw', 'review_id': 284380913, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679} 2025-03-10 00:31:07 [reviews] INFO: Scraped item: {'review': 'Ramesh Belli served us well! Great food', 'review_id': 284301021, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679} 2025-03-10 00:31:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37679&page=1> {'review': 'Ramesh Belli served us well! Great food', 'review_id': 284301021, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679} 2025-03-10 00:31:07 [reviews] INFO: Scraped item: {'review': 'My favourite restaurant since my childhood. I love their Chole Bhature more than anything else', 'review_id': 284059281, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679} 2025-03-10 00:31:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37679&page=1> {'review': 'My favourite restaurant since my childhood. I love their Chole Bhature more than anything else', 'review_id': 284059281, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679} 2025-03-10 00:31:07 [reviews] INFO: Scraped item: {'review': 'You call this quantity? Not even quality was matched! SO EXPENSIVE AND VERY LESS QUANTITY WITH LOW QUALITY!', 'review_id': 283916676, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679} 2025-03-10 00:31:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37679&page=1> {'review': 'You call this quantity? Not even quality was matched! SO EXPENSIVE AND VERY LESS QUANTITY WITH LOW QUALITY!', 'review_id': 283916676, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679} 2025-03-10 00:31:07 [reviews] INFO: Scraped item: {'review': 'Food was great', 'review_id': 283741476, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679} 2025-03-10 00:31:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37679&page=1> {'review': 'Food was great', 'review_id': 283741476, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'CHOWPATTY', 'platform': 'zomato', 'res_id': 37679} 2025-03-10 00:31:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:31:12 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741566612, 'download_latency': 0.7276582717895508, 'depth': 0} 2025-03-10 00:31:12 [reviews] INFO: Scraped item: {'review': 'The restaurant sent our mojito in a freaking tiffin box, no straw no tissues, crap.', 'review_id': 284604088, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823} 2025-03-10 00:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37823&page=1> {'review': 'The restaurant sent our mojito in a freaking tiffin box, no straw no tissues, crap.', 'review_id': 284604088, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823} 2025-03-10 00:31:12 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284514259, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823} 2025-03-10 00:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37823&page=1> {'review': '', 'review_id': 284514259, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823} 2025-03-10 00:31:12 [reviews] INFO: Scraped item: {'review': 'Chicken in Sapo sauce was bitter, rest all okay.', 'review_id': 283935750, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823} 2025-03-10 00:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37823&page=1> {'review': 'Chicken in Sapo sauce was bitter, rest all okay.', 'review_id': 283935750, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823} 2025-03-10 00:31:12 [reviews] INFO: Scraped item: {'review': 'Fried rice was very sweet', 'review_id': 283909319, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823} 2025-03-10 00:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37823&page=1> {'review': 'Fried rice was very sweet', 'review_id': 283909319, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823} 2025-03-10 00:31:12 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283761854, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823} 2025-03-10 00:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=37823&page=1> {'review': '', 'review_id': 283761854, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 37823} 2025-03-10 00:31:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:31:15 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 0, 'brand_name': 'Relish', 'city': 'Mumbai', 'sub_zone': 'Churchgate', 'platform': 'zomato', 'res_id': 37978, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741566615, 'download_latency': 0.7552149295806885, 'depth': 0} 2025-03-10 00:31:15 [reviews] INFO: Stopping for res_id: 37978 as reviews are older than 7 days. 2025-03-10 00:31:19 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:31:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-10 00:31:21 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-10 00:31:23 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:31:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:31:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-10 00:31:36 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-10 00:31:37 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:31:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:31:44 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:31:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:31:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-10 00:31:51 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-10 00:31:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:31:53 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 64, 'brand_name': "Jim - Me's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Hill Road ', 'platform': 'zomato', 'res_id': 38512, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741566649, 'download_latency': 0.884573221206665, 'depth': 0} 2025-03-10 00:31:53 [reviews] INFO: Scraped item: {'review': "i had informed before ordering please don't add egg y u put egg I am allergy to egg now how to eat the food", 'review_id': 282604084, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 64, 'brand_name': "Jim - Me's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Hill Road ', 'platform': 'zomato', 'res_id': 38512} 2025-03-10 00:31:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=38512&page=1> {'review': "i had informed before ordering please don't add egg y u put egg I am allergy to egg now how to eat the food", 'review_id': 282604084, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 64, 'brand_name': "Jim - Me's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Hill Road ', 'platform': 'zomato', 'res_id': 38512} 2025-03-10 00:31:53 [reviews] INFO: Stopping for res_id: 38512 as reviews are older than 7 days. 2025-03-10 00:31:55 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:32:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:32:00 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 69, 'brand_name': 'Asian Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 38797, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741566657, 'download_latency': 0.9947612285614014, 'depth': 0} 2025-03-10 00:32:00 [reviews] INFO: Stopping for res_id: 38797 as reviews are older than 7 days. 2025-03-10 00:32:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:32:04 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'PHOENIX', 'platform': 'zomato', 'res_id': 39528, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741566661, 'download_latency': 0.7937510013580322, 'depth': 0} 2025-03-10 00:32:04 [reviews] INFO: Scraped item: {'review': 'service and food is really good.', 'review_id': 283374662, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'PHOENIX', 'platform': 'zomato', 'res_id': 39528} 2025-03-10 00:32:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=39528&page=1> {'review': 'service and food is really good.', 'review_id': 283374662, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'PHOENIX', 'platform': 'zomato', 'res_id': 39528} 2025-03-10 00:32:04 [reviews] INFO: Stopping for res_id: 39528 as reviews are older than 7 days. 2025-03-10 00:32:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-10 00:32:06 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-10 00:32:06 [scrapy.extensions.logstats] INFO: Crawled 21 pages (at 6 pages/min), scraped 70 items (at 12 items/min) 2025-03-10 00:32:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:32:07 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 39, 'brand_name': 'Yauatcha', 'city': 'Mumbai', 'sub_zone': 'Bandra Kurla Complex', 'platform': 'zomato', 'res_id': 39675, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741566664, 'download_latency': 0.697829008102417, 'depth': 0} 2025-03-10 00:32:07 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284523884, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 39, 'brand_name': 'Yauatcha', 'city': 'Mumbai', 'sub_zone': 'Bandra Kurla Complex', 'platform': 'zomato', 'res_id': 39675} 2025-03-10 00:32:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=39675&page=1> {'review': '', 'review_id': 284523884, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 39, 'brand_name': 'Yauatcha', 'city': 'Mumbai', 'sub_zone': 'Bandra Kurla Complex', 'platform': 'zomato', 'res_id': 39675} 2025-03-10 00:32:07 [reviews] INFO: Scraped item: {'review': 'Really impressed with the service by saif and nikhil thanks to you both', 'review_id': 284167556, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 39, 'brand_name': 'Yauatcha', 'city': 'Mumbai', 'sub_zone': 'Bandra Kurla Complex', 'platform': 'zomato', 'res_id': 39675} 2025-03-10 00:32:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=39675&page=1> {'review': 'Really impressed with the service by saif and nikhil thanks to you both', 'review_id': 284167556, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 39, 'brand_name': 'Yauatcha', 'city': 'Mumbai', 'sub_zone': 'Bandra Kurla Complex', 'platform': 'zomato', 'res_id': 39675} 2025-03-10 00:32:07 [reviews] INFO: Scraped item: {'review': 'The cake had shifted to one side', 'review_id': 284042110, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 39, 'brand_name': 'Yauatcha', 'city': 'Mumbai', 'sub_zone': 'Bandra Kurla Complex', 'platform': 'zomato', 'res_id': 39675} 2025-03-10 00:32:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=39675&page=1> {'review': 'The cake had shifted to one side', 'review_id': 284042110, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 39, 'brand_name': 'Yauatcha', 'city': 'Mumbai', 'sub_zone': 'Bandra Kurla Complex', 'platform': 'zomato', 'res_id': 39675} 2025-03-10 00:32:07 [reviews] INFO: Scraped item: {'review': 'Cakes are amazing', 'review_id': 283803319, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 39, 'brand_name': 'Yauatcha', 'city': 'Mumbai', 'sub_zone': 'Bandra Kurla Complex', 'platform': 'zomato', 'res_id': 39675} 2025-03-10 00:32:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=39675&page=1> {'review': 'Cakes are amazing', 'review_id': 283803319, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 39, 'brand_name': 'Yauatcha', 'city': 'Mumbai', 'sub_zone': 'Bandra Kurla Complex', 'platform': 'zomato', 'res_id': 39675} 2025-03-10 00:32:07 [reviews] INFO: Scraped item: {'review': 'The staff here is very cooperative and kind. Thanks to Gagan, Maza and Nikhil', 'review_id': 282946303, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-05', 'competitor_id': 39, 'brand_name': 'Yauatcha', 'city': 'Mumbai', 'sub_zone': 'Bandra Kurla Complex', 'platform': 'zomato', 'res_id': 39675} 2025-03-10 00:32:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=39675&page=1> {'review': 'The staff here is very cooperative and kind. Thanks to Gagan, Maza and Nikhil', 'review_id': 282946303, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-05', 'competitor_id': 39, 'brand_name': 'Yauatcha', 'city': 'Mumbai', 'sub_zone': 'Bandra Kurla Complex', 'platform': 'zomato', 'res_id': 39675} 2025-03-10 00:32:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:32:14 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741566668, 'download_latency': 2.8290698528289795, 'depth': 0} 2025-03-10 00:32:14 [reviews] INFO: Scraped item: {'review': 'good quality and quantity ', 'review_id': 284456772, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083} 2025-03-10 00:32:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=40083&page=1> {'review': 'good quality and quantity ', 'review_id': 284456772, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083} 2025-03-10 00:32:14 [reviews] INFO: Scraped item: {'review': 'Schezwan kharab hua mila 4 packets the sab kharab combination rice dish mai n triple Schezwan rice mai bs egg ka difference tha baki koi difference nhi aisa laga chaval n noodles ko garam karke usmai chicken egg n oil red color dalkr dediya bs very disappointed guys gharpe sabka mood off bcz off u guys', 'review_id': 284122447, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083} 2025-03-10 00:32:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=40083&page=1> {'review': 'Schezwan kharab hua mila 4 packets the sab kharab combination rice dish mai n triple Schezwan rice mai bs egg ka difference tha baki koi difference nhi aisa laga chaval n noodles ko garam karke usmai chicken egg n oil red color dalkr dediya bs very disappointed guys gharpe sabka mood off bcz off u guys', 'review_id': 284122447, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083} 2025-03-10 00:32:14 [reviews] INFO: Scraped item: {'review': 'there was 3 lollipop in description but delivered only 2 pieces. what is this ??', 'review_id': 283568613, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083} 2025-03-10 00:32:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=40083&page=1> {'review': 'there was 3 lollipop in description but delivered only 2 pieces. what is this ??', 'review_id': 283568613, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083} 2025-03-10 00:32:14 [reviews] INFO: Scraped item: {'review': 'no dry noodles, no schezwan chutney. disappointed', 'review_id': 283139967, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083} 2025-03-10 00:32:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=40083&page=1> {'review': 'no dry noodles, no schezwan chutney. disappointed', 'review_id': 283139967, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 67, 'brand_name': 'Vishal Chinese', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 40083} 2025-03-10 00:32:14 [reviews] INFO: Stopping for res_id: 40083 as reviews are older than 7 days. 2025-03-10 00:32:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:32:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:32:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:32:26 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:32:30 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:32:34 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:32:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-10 00:32:36 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-10 00:32:38 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:32:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:32:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:32:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:32:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:32:54 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741566713, 'download_latency': 0.8250014781951904, 'depth': 0} 2025-03-10 00:32:54 [reviews] INFO: Scraped item: {'review': 'Awesome ', 'review_id': 284604319, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143} 2025-03-10 00:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=41143&page=1> {'review': 'Awesome ', 'review_id': 284604319, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143} 2025-03-10 00:32:54 [reviews] INFO: Scraped item: {'review': 'The food was delayed by almost an hr. and the food taste was not at all good ', 'review_id': 284581394, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143} 2025-03-10 00:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=41143&page=1> {'review': 'The food was delayed by almost an hr. and the food taste was not at all good ', 'review_id': 284581394, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143} 2025-03-10 00:32:54 [reviews] INFO: Scraped item: {'review': 'Water chestnut was a disaster..we actually dint eat at all', 'review_id': 284368496, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143} 2025-03-10 00:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=41143&page=1> {'review': 'Water chestnut was a disaster..we actually dint eat at all', 'review_id': 284368496, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143} 2025-03-10 00:32:54 [reviews] INFO: Scraped item: {'review': 'Delay in preparation', 'review_id': 284071217, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143} 2025-03-10 00:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=41143&page=1> {'review': 'Delay in preparation', 'review_id': 284071217, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143} 2025-03-10 00:32:54 [reviews] INFO: Scraped item: {'review': 'undercooked food', 'review_id': 284032890, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143} 2025-03-10 00:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=41143&page=1> {'review': 'undercooked food', 'review_id': 284032890, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 41143} 2025-03-10 00:32:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:33:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:33:01 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 63, 'brand_name': 'Cocoon- Dragonfly Hotel', 'city': 'Mumbai', 'sub_zone': 'Chakala', 'platform': 'zomato', 'res_id': 42630, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741566720, 'download_latency': 0.6561770439147949, 'depth': 0} 2025-03-10 00:33:01 [reviews] INFO: Stopping for res_id: 42630 as reviews are older than 7 days. 2025-03-10 00:33:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:33:06 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 66, 'brand_name': 'Red Chilli', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 42695, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741566724, 'download_latency': 0.6739792823791504, 'depth': 0} 2025-03-10 00:33:06 [reviews] INFO: Stopping for res_id: 42695 as reviews are older than 7 days. 2025-03-10 00:33:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-10 00:33:06 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-10 00:33:06 [scrapy.extensions.logstats] INFO: Crawled 26 pages (at 5 pages/min), scraped 84 items (at 14 items/min) 2025-03-10 00:33:08 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:33:09 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'RCITY', 'platform': 'zomato', 'res_id': 43965, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741566727, 'download_latency': 0.6329464912414551, 'depth': 0} 2025-03-10 00:33:09 [reviews] INFO: Scraped item: {'review': 'Tasty Food and Amazing taste', 'review_id': 284554848, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'RCITY', 'platform': 'zomato', 'res_id': 43965} 2025-03-10 00:33:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=43965&page=1> {'review': 'Tasty Food and Amazing taste', 'review_id': 284554848, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'RCITY', 'platform': 'zomato', 'res_id': 43965} 2025-03-10 00:33:09 [reviews] INFO: Scraped item: {'review': 'superb food ๐Ÿ‘Œ ', 'review_id': 284551489, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'RCITY', 'platform': 'zomato', 'res_id': 43965} 2025-03-10 00:33:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=43965&page=1> {'review': 'superb food ๐Ÿ‘Œ ', 'review_id': 284551489, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'RCITY', 'platform': 'zomato', 'res_id': 43965} 2025-03-10 00:33:09 [reviews] INFO: Scraped item: {'review': 'The pizza was g8โ€ฆ sizzler was okish', 'review_id': 284551083, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'RCITY', 'platform': 'zomato', 'res_id': 43965} 2025-03-10 00:33:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=43965&page=1> {'review': 'The pizza was g8โ€ฆ sizzler was okish', 'review_id': 284551083, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'RCITY', 'platform': 'zomato', 'res_id': 43965} 2025-03-10 00:33:09 [reviews] INFO: Scraped item: {'review': 'The food is really nice. The service is really good ', 'review_id': 284549070, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'RCITY', 'platform': 'zomato', 'res_id': 43965} 2025-03-10 00:33:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=43965&page=1> {'review': 'The food is really nice. The service is really good ', 'review_id': 284549070, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'RCITY', 'platform': 'zomato', 'res_id': 43965} 2025-03-10 00:33:09 [reviews] INFO: Scraped item: {'review': 'food was excellent we enjoyed ', 'review_id': 284510296, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'RCITY', 'platform': 'zomato', 'res_id': 43965} 2025-03-10 00:33:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=43965&page=1> {'review': 'food was excellent we enjoyed ', 'review_id': 284510296, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'RCITY', 'platform': 'zomato', 'res_id': 43965} 2025-03-10 00:33:12 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:33:15 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:33:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:33:23 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:33:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:33:30 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:33:34 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:33:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-10 00:33:36 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-10 00:33:38 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:33:43 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:33:45 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:33:47 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:33:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:33:50 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741566775, 'download_latency': 0.6773862838745117, 'depth': 0} 2025-03-10 00:33:50 [reviews] INFO: Scraped item: {'review': 'the food was great, good vibe', 'review_id': 284566115, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672} 2025-03-10 00:33:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=46672&page=1> {'review': 'the food was great, good vibe', 'review_id': 284566115, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672} 2025-03-10 00:33:50 [reviews] INFO: Scraped item: {'review': 'tasty food and superb service Dilip sawant made us feel like home', 'review_id': 284557605, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672} 2025-03-10 00:33:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=46672&page=1> {'review': 'tasty food and superb service Dilip sawant made us feel like home', 'review_id': 284557605, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672} 2025-03-10 00:33:50 [reviews] INFO: Scraped item: {'review': 'Great service and food! Dahi puri is the best', 'review_id': 284546668, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672} 2025-03-10 00:33:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=46672&page=1> {'review': 'Great service and food! Dahi puri is the best', 'review_id': 284546668, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672} 2025-03-10 00:33:50 [reviews] INFO: Scraped item: {'review': 'Friendly staff and quick service. Quality of food was also quite good.', 'review_id': 284537958, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672} 2025-03-10 00:33:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=46672&page=1> {'review': 'Friendly staff and quick service. Quality of food was also quite good.', 'review_id': 284537958, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672} 2025-03-10 00:33:50 [reviews] INFO: Scraped item: {'review': 'Awesome service and food.', 'review_id': 284521318, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672} 2025-03-10 00:33:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=46672&page=1> {'review': 'Awesome service and food.', 'review_id': 284521318, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'INORBIT MALL', 'platform': 'zomato', 'res_id': 46672} 2025-03-10 00:33:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:33:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:34:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:34:01 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 26, 'brand_name': 'Starbucks Coffee', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 47111, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741566786, 'download_latency': 0.6461262702941895, 'depth': 0} 2025-03-10 00:34:01 [reviews] INFO: Stopping for res_id: 47111 as reviews are older than 7 days. 2025-03-10 00:34:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:34:06 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741566789, 'download_latency': 0.7293965816497803, 'depth': 0} 2025-03-10 00:34:06 [reviews] INFO: Scraped item: {'review': 'Crispy corn was not at all crispy when it reached home. And kung pao chicken was sweet dint like the taste', 'review_id': 284616513, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171} 2025-03-10 00:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47171&page=1> {'review': 'Crispy corn was not at all crispy when it reached home. And kung pao chicken was sweet dint like the taste', 'review_id': 284616513, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171} 2025-03-10 00:34:06 [reviews] INFO: Scraped item: {'review': 'Amazing taste and quality', 'review_id': 284599376, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171} 2025-03-10 00:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47171&page=1> {'review': 'Amazing taste and quality', 'review_id': 284599376, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171} 2025-03-10 00:34:06 [reviews] INFO: Scraped item: {'review': 'Very bland and makes the stomach a little upset', 'review_id': 284154906, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171} 2025-03-10 00:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47171&page=1> {'review': 'Very bland and makes the stomach a little upset', 'review_id': 284154906, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171} 2025-03-10 00:34:06 [reviews] INFO: Scraped item: {'review': 'Too much of noodle on the threaded paneer. It was so hard like stone.', 'review_id': 284139708, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171} 2025-03-10 00:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47171&page=1> {'review': 'Too much of noodle on the threaded paneer. It was so hard like stone.', 'review_id': 284139708, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171} 2025-03-10 00:34:06 [reviews] INFO: Scraped item: {'review': 'The food was not good. The rice and chicken were uncooked and I had to throw away ', 'review_id': 283253353, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171} 2025-03-10 00:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47171&page=1> {'review': 'The food was not good. The rice and chicken were uncooked and I had to throw away ', 'review_id': 283253353, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 65, 'brand_name': 'King Chilli Chindian Fusion', 'city': 'Mumbai', 'sub_zone': 'Santacruz East', 'platform': 'zomato', 'res_id': 47171} 2025-03-10 00:34:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-10 00:34:06 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-10 00:34:06 [scrapy.extensions.logstats] INFO: Crawled 30 pages (at 4 pages/min), scraped 99 items (at 15 items/min) 2025-03-10 00:34:08 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:34:13 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:34:17 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:34:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:34:25 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:34:28 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:34:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:34:34 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:34:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-10 00:34:36 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-10 00:34:37 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:34:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:34:44 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:34:48 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:34:53 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:34:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:35:01 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:35:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:35:05 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741566846, 'download_latency': 1.806502342224121, 'depth': 0} 2025-03-10 00:35:05 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284613534, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458} 2025-03-10 00:35:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47458&page=1> {'review': '', 'review_id': 284613534, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458} 2025-03-10 00:35:05 [reviews] INFO: Scraped item: {'review': 'No taste regular biryani ', 'review_id': 284610799, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458} 2025-03-10 00:35:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47458&page=1> {'review': 'No taste regular biryani ', 'review_id': 284610799, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458} 2025-03-10 00:35:05 [reviews] INFO: Scraped item: {'review': 'Burnt Also the masala was more then the rice not good', 'review_id': 284524191, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458} 2025-03-10 00:35:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47458&page=1> {'review': 'Burnt Also the masala was more then the rice not good', 'review_id': 284524191, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458} 2025-03-10 00:35:05 [reviews] INFO: Scraped item: {'review': 'Butter Chicken Meal Box is a comforting delightโ€”rich, creamy butter chicken gravy paired with soft, fresh naan, making for a satisfying and indulgent meal', 'review_id': 284357008, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458} 2025-03-10 00:35:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47458&page=1> {'review': 'Butter Chicken Meal Box is a comforting delightโ€”rich, creamy butter chicken gravy paired with soft, fresh naan, making for a satisfying and indulgent meal', 'review_id': 284357008, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458} 2025-03-10 00:35:05 [reviews] INFO: Scraped item: {'review': 'Punjabi Meal Box comes in neat and secure packaging, keeping the food fresh and mess-free. The flavors are rich and authentic, with a satisfying portion thatโ€™s perfect for one person. A great choice for a hearty and convenient meal', 'review_id': 284354462, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458} 2025-03-10 00:35:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=47458&page=1> {'review': 'Punjabi Meal Box comes in neat and secure packaging, keeping the food fresh and mess-free. The flavors are rich and authentic, with a satisfying portion thatโ€™s perfect for one person. A great choice for a hearty and convenient meal', 'review_id': 284354462, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari West', 'platform': 'zomato', 'res_id': 47458} 2025-03-10 00:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-10 00:35:06 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-10 00:35:06 [scrapy.extensions.logstats] INFO: Crawled 31 pages (at 1 pages/min), scraped 104 items (at 5 items/min) 2025-03-10 00:35:08 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:35:10 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:35:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:35:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:35:21 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:35:25 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:35:29 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:35:33 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:35:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-10 00:35:36 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-10 00:35:37 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:35:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:35:44 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:35:48 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:35:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:35:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:35:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:36:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-10 00:36:06 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-10 00:36:06 [scrapy.extensions.logstats] INFO: Crawled 31 pages (at 0 pages/min), scraped 104 items (at 0 items/min) 2025-03-10 00:36:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:36:10 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:36:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:36:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:36:19 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:36:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:36:27 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:36:31 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:36:36 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-10 00:36:36 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-10 00:36:39 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:36:44 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:36:47 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:36:51 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:36:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:36:58 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:37:00 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:37:03 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-10 00:37:06 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-10 00:37:06 [scrapy.extensions.logstats] INFO: Crawled 31 pages (at 0 pages/min), scraped 104 items (at 0 items/min) 2025-03-10 00:37:08 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:37:12 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:37:15 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:37:20 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:37:24 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:37:28 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:37:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:37:34 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Matunga East', 'platform': 'zomato', 'res_id': 48066, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741566992, 'download_latency': 1.718628168106079, 'depth': 0} 2025-03-10 00:37:34 [reviews] ERROR: Unrecognized relative_date format: nov 18, 2022 2025-03-10 00:37:34 [reviews] INFO: Stopping for res_id: 48066 due to unrecognized date format: Nov 18, 2022. 2025-03-10 00:37:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-10 00:37:36 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-10 00:37:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:37:36 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741566996, 'download_latency': 0.6987564563751221, 'depth': 0} 2025-03-10 00:37:36 [reviews] INFO: Scraped item: {'review': 'its not same as I ordered. pathetic in taste ', 'review_id': 284627043, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323} 2025-03-10 00:37:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=48323&page=1> {'review': 'its not same as I ordered. pathetic in taste ', 'review_id': 284627043, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323} 2025-03-10 00:37:36 [reviews] INFO: Scraped item: {'review': 'Ordered during Ramadan, and the service was flawless! The dishes were flavorful and came in hygienic packaging, making it a wonderful experience.', 'review_id': 284605824, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323} 2025-03-10 00:37:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=48323&page=1> {'review': 'Ordered during Ramadan, and the service was flawless! The dishes were flavorful and came in hygienic packaging, making it a wonderful experience.', 'review_id': 284605824, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323} 2025-03-10 00:37:36 [reviews] INFO: Scraped item: {'review': 'The Iftar delivery was smooth and reliable! The food was fresh and packed with flavor, and the portions were truly generous.', 'review_id': 284589609, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323} 2025-03-10 00:37:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=48323&page=1> {'review': 'The Iftar delivery was smooth and reliable! The food was fresh and packed with flavor, and the portions were truly generous.', 'review_id': 284589609, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323} 2025-03-10 00:37:36 [reviews] INFO: Scraped item: {'review': 'The biryani was a letdownโ€”clearly not fresh.', 'review_id': 284510196, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323} 2025-03-10 00:37:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=48323&page=1> {'review': 'The biryani was a letdownโ€”clearly not fresh.', 'review_id': 284510196, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323} 2025-03-10 00:37:36 [reviews] INFO: Scraped item: {'review': 'Ordered Iftar during Ramadan, and the delivery was impressive! The food was hot and fresh with authentic spices, making it a truly flavourful and satisfying meal', 'review_id': 284356240, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323} 2025-03-10 00:37:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=48323&page=1> {'review': 'Ordered Iftar during Ramadan, and the delivery was impressive! The food was hot and fresh with authentic spices, making it a truly flavourful and satisfying meal', 'review_id': 284356240, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Marol', 'platform': 'zomato', 'res_id': 48323} 2025-03-10 00:37:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:37:41 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 70, 'brand_name': 'Wok Hei', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 48693, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567000, 'download_latency': 0.694859504699707, 'depth': 0} 2025-03-10 00:37:41 [reviews] INFO: Scraped item: {'review': 'good offers on food menu n also mocktail drinks . food quality also good', 'review_id': 284242375, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 70, 'brand_name': 'Wok Hei', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 48693} 2025-03-10 00:37:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=48693&page=1> {'review': 'good offers on food menu n also mocktail drinks . food quality also good', 'review_id': 284242375, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 70, 'brand_name': 'Wok Hei', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 48693} 2025-03-10 00:37:41 [reviews] INFO: Scraped item: {'review': 'yummy ๐Ÿ˜‹ ', 'review_id': 282898037, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 70, 'brand_name': 'Wok Hei', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 48693} 2025-03-10 00:37:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=48693&page=1> {'review': 'yummy ๐Ÿ˜‹ ', 'review_id': 282898037, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 70, 'brand_name': 'Wok Hei', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 48693} 2025-03-10 00:37:41 [reviews] INFO: Stopping for res_id: 48693 as reviews are older than 7 days. 2025-03-10 00:37:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:37:45 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567004, 'download_latency': 0.8910341262817383, 'depth': 0} 2025-03-10 00:37:45 [reviews] INFO: Scraped item: {'review': 'Wrong product received and taste was also not up to the mark and items were missing in the parcel', 'review_id': 284627976, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608} 2025-03-10 00:37:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=49608&page=1> {'review': 'Wrong product received and taste was also not up to the mark and items were missing in the parcel', 'review_id': 284627976, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608} 2025-03-10 00:37:45 [reviews] INFO: Scraped item: {'review': 'The egg noodles were delicious ', 'review_id': 284458950, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608} 2025-03-10 00:37:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=49608&page=1> {'review': 'The egg noodles were delicious ', 'review_id': 284458950, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608} 2025-03-10 00:37:45 [reviews] INFO: Scraped item: {'review': 'Extremely spicy food', 'review_id': 284331641, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608} 2025-03-10 00:37:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=49608&page=1> {'review': 'Extremely spicy food', 'review_id': 284331641, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608} 2025-03-10 00:37:45 [reviews] INFO: Scraped item: {'review': 'there was no chicken at all in chicken triple fried rice
scammers
it was veg gravy with egg fried rice
scam restaurant', 'review_id': 284193937, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608} 2025-03-10 00:37:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=49608&page=1> {'review': 'there was no chicken at all in chicken triple fried rice
scammers
it was veg gravy with egg fried rice
scam restaurant', 'review_id': 284193937, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608} 2025-03-10 00:37:45 [reviews] INFO: Scraped item: {'review': 'The chicken fried wonton was not good at all. It was so expensive, and there wasnโ€™t even any chicken in it. I didnโ€™t like it.

', 'review_id': 283793226, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608} 2025-03-10 00:37:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=49608&page=1> {'review': 'The chicken fried wonton was not good at all. It was so expensive, and there wasnโ€™t even any chicken in it. I didnโ€™t like it.

', 'review_id': 283793226, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 72, 'brand_name': 'Silli Chilli', 'city': 'Mumbai', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 49608} 2025-03-10 00:37:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:37:49 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567008, 'download_latency': 1.132225751876831, 'depth': 0} 2025-03-10 00:37:49 [reviews] INFO: Scraped item: {'review': 'Just before blues I had B by kilo and that was really fresh. blues looked and tasted like briyani was cooked and they reheated, packed and delivered.', 'review_id': 284533675, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805} 2025-03-10 00:37:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=306805&page=1> {'review': 'Just before blues I had B by kilo and that was really fresh. blues looked and tasted like briyani was cooked and they reheated, packed and delivered.', 'review_id': 284533675, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805} 2025-03-10 00:37:49 [reviews] INFO: Scraped item: {'review': 'very bad experience for the food', 'review_id': 284437418, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805} 2025-03-10 00:37:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=306805&page=1> {'review': 'very bad experience for the food', 'review_id': 284437418, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805} 2025-03-10 00:37:49 [reviews] INFO: Scraped item: {'review': 'very tasty bhiriyani, really delicious.', 'review_id': 283946496, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805} 2025-03-10 00:37:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=306805&page=1> {'review': 'very tasty bhiriyani, really delicious.', 'review_id': 283946496, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805} 2025-03-10 00:37:49 [reviews] INFO: Scraped item: {'review': 'too spicy, had to eat with water and felt like eating red chilli chutney ', 'review_id': 283772584, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805} 2025-03-10 00:37:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=306805&page=1> {'review': 'too spicy, had to eat with water and felt like eating red chilli chutney ', 'review_id': 283772584, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805} 2025-03-10 00:37:49 [reviews] INFO: Scraped item: {'review': 'quantity less', 'review_id': 283682084, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805} 2025-03-10 00:37:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=306805&page=1> {'review': 'quantity less', 'review_id': 283682084, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Gurgaon ', 'sub_zone': 'Ninex City Mart Mall, Sohna Road', 'platform': 'zomato', 'res_id': 306805} 2025-03-10 00:37:53 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:37:56 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:37:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:37:59 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567019, 'download_latency': 0.6921789646148682, 'depth': 0} 2025-03-10 00:37:59 [reviews] INFO: Scraped item: {'review': 'mast', 'review_id': 284015320, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995} 2025-03-10 00:37:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=312995&page=1> {'review': 'mast', 'review_id': 284015320, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995} 2025-03-10 00:37:59 [reviews] INFO: Scraped item: {'review': 'The kebabs were cold and biryani was like pulao with just saffron and color in it. No taste, no flavour.', 'review_id': 283992258, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995} 2025-03-10 00:37:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=312995&page=1> {'review': 'The kebabs were cold and biryani was like pulao with just saffron and color in it. No taste, no flavour.', 'review_id': 283992258, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995} 2025-03-10 00:37:59 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283699498, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995} 2025-03-10 00:37:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=312995&page=1> {'review': '', 'review_id': 283699498, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995} 2025-03-10 00:37:59 [reviews] INFO: Scraped item: {'review': 'Not worthy', 'review_id': 283352285, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995} 2025-03-10 00:37:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=312995&page=1> {'review': 'Not worthy', 'review_id': 283352285, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995} 2025-03-10 00:37:59 [reviews] INFO: Scraped item: {'review': 'Salan hot spilled which spoiled the entire food', 'review_id': 283132968, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995} 2025-03-10 00:37:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=312995&page=1> {'review': 'Salan hot spilled which spoiled the entire food', 'review_id': 283132968, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon', 'sub_zone': 'MG Road', 'platform': 'zomato', 'res_id': 312995} 2025-03-10 00:38:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:38:03 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 40, 'brand_name': 'The Fatty Bao', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 17871363, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567021, 'download_latency': 0.6992282867431641, 'depth': 0} 2025-03-10 00:38:03 [reviews] INFO: Scraped item: {'review': 'No veggies but broccoli', 'review_id': 283647711, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 40, 'brand_name': 'The Fatty Bao', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 17871363} 2025-03-10 00:38:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=17871363&page=1> {'review': 'No veggies but broccoli', 'review_id': 283647711, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 40, 'brand_name': 'The Fatty Bao', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 17871363} 2025-03-10 00:38:03 [reviews] INFO: Scraped item: {'review': 'The meat in the salmom and crab sushi was literally very raw and no taste only the shrim sushi was perfect', 'review_id': 282830893, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 40, 'brand_name': 'The Fatty Bao', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 17871363} 2025-03-10 00:38:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=17871363&page=1> {'review': 'The meat in the salmom and crab sushi was literally very raw and no taste only the shrim sushi was perfect', 'review_id': 282830893, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 40, 'brand_name': 'The Fatty Bao', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 17871363} 2025-03-10 00:38:03 [reviews] INFO: Stopping for res_id: 17871363 as reviews are older than 7 days. 2025-03-10 00:38:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-10 00:38:06 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-10 00:38:06 [scrapy.extensions.logstats] INFO: Crawled 38 pages (at 7 pages/min), scraped 128 items (at 24 items/min) 2025-03-10 00:38:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:38:10 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:38:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:38:18 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:38:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:38:23 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 46, 'brand_name': 'China House - Hyatt Regency', 'city': 'Ahmedabad', 'sub_zone': 'Hyatt Regency, Ashram Road ', 'platform': 'zomato', 'res_id': 18161729, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567040, 'download_latency': 0.9897029399871826, 'depth': 0} 2025-03-10 00:38:23 [reviews] INFO: Stopping for res_id: 18161729 as reviews are older than 7 days. 2025-03-10 00:38:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:38:26 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 18165909, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567044, 'download_latency': 0.6680912971496582, 'depth': 0} 2025-03-10 00:38:26 [reviews] ERROR: Error parsing date: an hour ago, error: unsupported type for timedelta hours component: NoneType 2025-03-10 00:38:26 [reviews] INFO: Stopping for res_id: 18165909 due to unrecognized date format: an hour ago. 2025-03-10 00:38:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:38:30 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567049, 'download_latency': 0.6329154968261719, 'depth': 0} 2025-03-10 00:38:30 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284370772, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915} 2025-03-10 00:38:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18216915&page=1> {'review': '', 'review_id': 284370772, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915} 2025-03-10 00:38:30 [reviews] INFO: Scraped item: {'review': 'Biryani was yummy n hot', 'review_id': 284300564, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915} 2025-03-10 00:38:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18216915&page=1> {'review': 'Biryani was yummy n hot', 'review_id': 284300564, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915} 2025-03-10 00:38:30 [reviews] INFO: Scraped item: {'review': 'Tasty stuff. I appreciate. Thank you.', 'review_id': 284269245, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915} 2025-03-10 00:38:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18216915&page=1> {'review': 'Tasty stuff. I appreciate. Thank you.', 'review_id': 284269245, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915} 2025-03-10 00:38:30 [reviews] INFO: Scraped item: {'review': 'The chaap itself js very chewy i like it but the rice is so dry. There is literally only pieces of chaap with no gravy at all.', 'review_id': 284237976, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915} 2025-03-10 00:38:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18216915&page=1> {'review': 'The chaap itself js very chewy i like it but the rice is so dry. There is literally only pieces of chaap with no gravy at all.', 'review_id': 284237976, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915} 2025-03-10 00:38:30 [reviews] INFO: Scraped item: {'review': 'Whenever I come to Delhi, I eat their Chicken 65 Biryani. โค๏ธ', 'review_id': 284078538, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915} 2025-03-10 00:38:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18216915&page=1> {'review': 'Whenever I come to Delhi, I eat their Chicken 65 Biryani. โค๏ธ', 'review_id': 284078538, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18216915} 2025-03-10 00:38:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:38:34 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Kandivali East', 'platform': 'zomato', 'res_id': 18257196, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567055, 'download_latency': 0.6733689308166504, 'depth': 0} 2025-03-10 00:38:34 [reviews] ERROR: Unrecognized relative_date format: may 27, 2021 2025-03-10 00:38:34 [reviews] INFO: Stopping for res_id: 18257196 due to unrecognized date format: May 27, 2021. 2025-03-10 00:38:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:38:38 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567057, 'download_latency': 0.6950032711029053, 'depth': 0} 2025-03-10 00:38:38 [reviews] INFO: Scraped item: {'review': 'I have ordered from persia Darbar Chicken Schezwan fried rice and chicken chutney kabab. "Persia Darbar\'s Chicken Schezwan Fried Rice is a flavor explosion! Spicy Schezwan sauce, savory chicken, and fragrant rice come together in perfect harmony. chicken chutney kabab also tasty with soft juicy chicken. A must-try for fans of spicy food!"', 'review_id': 284214859, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118} 2025-03-10 00:38:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18324118&page=1> {'review': 'I have ordered from persia Darbar Chicken Schezwan fried rice and chicken chutney kabab. "Persia Darbar\'s Chicken Schezwan Fried Rice is a flavor explosion! Spicy Schezwan sauce, savory chicken, and fragrant rice come together in perfect harmony. chicken chutney kabab also tasty with soft juicy chicken. A must-try for fans of spicy food!"', 'review_id': 284214859, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118} 2025-03-10 00:38:38 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283918465, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118} 2025-03-10 00:38:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18324118&page=1> {'review': '', 'review_id': 283918465, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118} 2025-03-10 00:38:38 [reviews] INFO: Scraped item: {'review': 'Great flavors, Great service thank you ', 'review_id': 283740720, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118} 2025-03-10 00:38:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18324118&page=1> {'review': 'Great flavors, Great service thank you ', 'review_id': 283740720, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118} 2025-03-10 00:38:38 [reviews] INFO: Scraped item: {'review': 'the haleem and aab gosht was just boiled mutton dunked in their respective gravy. not at all authentic ', 'review_id': 283653028, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118} 2025-03-10 00:38:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18324118&page=1> {'review': 'the haleem and aab gosht was just boiled mutton dunked in their respective gravy. not at all authentic ', 'review_id': 283653028, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118} 2025-03-10 00:38:38 [reviews] INFO: Scraped item: {'review': 'too much oil and soup was sweet ', 'review_id': 283639475, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118} 2025-03-10 00:38:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18324118&page=1> {'review': 'too much oil and soup was sweet ', 'review_id': 283639475, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '7 Bungalows, Andheri West', 'platform': 'zomato', 'res_id': 18324118} 2025-03-10 00:38:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:38:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:38:47 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Phoenix Marketcity (Kurla)', 'platform': 'zomato', 'res_id': 18326064, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567066, 'download_latency': 0.6667847633361816, 'depth': 0} 2025-03-10 00:38:47 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284551706, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Phoenix Marketcity (Kurla)', 'platform': 'zomato', 'res_id': 18326064} 2025-03-10 00:38:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18326064&page=1> {'review': '', 'review_id': 284551706, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Phoenix Marketcity (Kurla)', 'platform': 'zomato', 'res_id': 18326064} 2025-03-10 00:38:47 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284103745, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Phoenix Marketcity (Kurla)', 'platform': 'zomato', 'res_id': 18326064} 2025-03-10 00:38:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18326064&page=1> {'review': '', 'review_id': 284103745, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Phoenix Marketcity (Kurla)', 'platform': 'zomato', 'res_id': 18326064} 2025-03-10 00:38:47 [reviews] INFO: Stopping for res_id: 18326064 as reviews are older than 7 days. 2025-03-10 00:38:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:38:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:38:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:39:02 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:39:05 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-10 00:39:06 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-10 00:39:06 [scrapy.extensions.logstats] INFO: Crawled 44 pages (at 6 pages/min), scraped 140 items (at 12 items/min) 2025-03-10 00:39:09 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:39:11 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:39:15 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:39:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:39:20 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567099, 'download_latency': 0.7014346122741699, 'depth': 0} 2025-03-10 00:39:20 [reviews] INFO: Scraped item: {'review': 'undercooked Chicken..inedible food..how can your rice also be undercooked and chicken stale!', 'review_id': 284157920, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461} 2025-03-10 00:39:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18349461&page=1> {'review': 'undercooked Chicken..inedible food..how can your rice also be undercooked and chicken stale!', 'review_id': 284157920, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461} 2025-03-10 00:39:20 [reviews] INFO: Scraped item: {'review': "i had stones in my biryani ๐Ÿ˜
a good quality basmati rice would never have stones
In fact I don't think this is basmati
just cheap long grain rice
ruined my biryani experience ", 'review_id': 284029302, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461} 2025-03-10 00:39:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18349461&page=1> {'review': "i had stones in my biryani ๐Ÿ˜
a good quality basmati rice would never have stones
In fact I don't think this is basmati
just cheap long grain rice
ruined my biryani experience ", 'review_id': 284029302, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461} 2025-03-10 00:39:20 [reviews] INFO: Scraped item: {'review': 'The biryani was not worth and it was very dry', 'review_id': 283447214, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461} 2025-03-10 00:39:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18349461&page=1> {'review': 'The biryani was not worth and it was very dry', 'review_id': 283447214, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461} 2025-03-10 00:39:20 [reviews] INFO: Scraped item: {'review': 'bad service ', 'review_id': 283445535, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461} 2025-03-10 00:39:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18349461&page=1> {'review': 'bad service ', 'review_id': 283445535, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461} 2025-03-10 00:39:20 [reviews] INFO: Scraped item: {'review': 'good in taste ', 'review_id': 283159261, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461} 2025-03-10 00:39:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18349461&page=1> {'review': 'good in taste ', 'review_id': 283159261, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'K Star Mall, Chembur', 'platform': 'zomato', 'res_id': 18349461} 2025-03-10 00:39:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:39:24 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18350121, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567103, 'download_latency': 0.6869664192199707, 'depth': 0} 2025-03-10 00:39:24 [reviews] INFO: Stopping for res_id: 18350121 as reviews are older than 7 days. 2025-03-10 00:39:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:39:28 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567107, 'download_latency': 0.7939968109130859, 'depth': 0} 2025-03-10 00:39:28 [reviews] INFO: Scraped item: {'review': 'no panner in paneer subj biryani and not even masala subji that usually is there', 'review_id': 284156989, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082} 2025-03-10 00:39:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18363082&page=1> {'review': 'no panner in paneer subj biryani and not even masala subji that usually is there', 'review_id': 284156989, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082} 2025-03-10 00:39:28 [reviews] INFO: Scraped item: {'review': 'How can you have your rolls filled with mayonnaise it was terrible', 'review_id': 283624129, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082} 2025-03-10 00:39:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18363082&page=1> {'review': 'How can you have your rolls filled with mayonnaise it was terrible', 'review_id': 283624129, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082} 2025-03-10 00:39:28 [reviews] INFO: Scraped item: {'review': 'Only rice .. hardly any chicken .. have ordered this item before .. and this is really disappointing', 'review_id': 282782268, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082} 2025-03-10 00:39:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18363082&page=1> {'review': 'Only rice .. hardly any chicken .. have ordered this item before .. and this is really disappointing', 'review_id': 282782268, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082} 2025-03-10 00:39:28 [reviews] INFO: Scraped item: {'review': 'great keep it up ๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘', 'review_id': 282553536, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082} 2025-03-10 00:39:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18363082&page=1> {'review': 'great keep it up ๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘', 'review_id': 282553536, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082} 2025-03-10 00:39:28 [reviews] INFO: Scraped item: {'review': '', 'review_id': 282418509, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082} 2025-03-10 00:39:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18363082&page=1> {'review': '', 'review_id': 282418509, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon', 'sub_zone': 'Sikandarpur', 'platform': 'zomato', 'res_id': 18363082} 2025-03-10 00:39:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:39:31 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567111, 'download_latency': 0.6620590686798096, 'depth': 0} 2025-03-10 00:39:31 [reviews] INFO: Scraped item: {'review': 'everything excellent ๐Ÿ‘Œ', 'review_id': 284508561, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184} 2025-03-10 00:39:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365184&page=1> {'review': 'everything excellent ๐Ÿ‘Œ', 'review_id': 284508561, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184} 2025-03-10 00:39:31 [reviews] INFO: Scraped item: {'review': 'Food was amazing. Nachos were not that really good, despite being offered for free.', 'review_id': 284493164, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184} 2025-03-10 00:39:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365184&page=1> {'review': 'Food was amazing. Nachos were not that really good, despite being offered for free.', 'review_id': 284493164, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184} 2025-03-10 00:39:31 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284474816, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184} 2025-03-10 00:39:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365184&page=1> {'review': '', 'review_id': 284474816, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184} 2025-03-10 00:39:31 [reviews] INFO: Scraped item: {'review': 'Amazing service', 'review_id': 284316788, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184} 2025-03-10 00:39:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365184&page=1> {'review': 'Amazing service', 'review_id': 284316788, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184} 2025-03-10 00:39:31 [reviews] INFO: Scraped item: {'review': 'Nice good food and help by shahenshah', 'review_id': 284291362, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184} 2025-03-10 00:39:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365184&page=1> {'review': 'Nice good food and help by shahenshah', 'review_id': 284291362, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'ANDHERI', 'platform': 'zomato', 'res_id': 18365184} 2025-03-10 00:39:33 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:39:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:39:39 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18365355, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567119, 'download_latency': 3.261840343475342, 'depth': 0} 2025-03-10 00:39:39 [reviews] INFO: Scraped item: {'review': 'rice was soggy ', 'review_id': 283607491, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18365355} 2025-03-10 00:39:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365355&page=1> {'review': 'rice was soggy ', 'review_id': 283607491, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18365355} 2025-03-10 00:39:39 [reviews] INFO: Scraped item: {'review': 'the rice was very soggy', 'review_id': 283150122, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18365355} 2025-03-10 00:39:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365355&page=1> {'review': 'the rice was very soggy', 'review_id': 283150122, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18365355} 2025-03-10 00:39:39 [reviews] INFO: Scraped item: {'review': 'filled with lots of masala not worthy at all ', 'review_id': 283135575, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18365355} 2025-03-10 00:39:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365355&page=1> {'review': 'filled with lots of masala not worthy at all ', 'review_id': 283135575, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18365355} 2025-03-10 00:39:39 [reviews] INFO: Stopping for res_id: 18365355 as reviews are older than 7 days. 2025-03-10 00:39:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:39:45 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:39:48 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:39:52 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:39:56 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:39:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:39:59 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567143, 'download_latency': 0.8235163688659668, 'depth': 0} 2025-03-10 00:39:59 [reviews] INFO: Scraped item: {'review': 'very less quantity ordered @750 but quantity is for one person, worst experience ', 'review_id': 284611922, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868} 2025-03-10 00:39:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365868&page=1> {'review': 'very less quantity ordered @750 but quantity is for one person, worst experience ', 'review_id': 284611922, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868} 2025-03-10 00:39:59 [reviews] INFO: Scraped item: {'review': 'Birayani was awsm and cutlery was not from the restaurant', 'review_id': 284575892, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868} 2025-03-10 00:39:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365868&page=1> {'review': 'Birayani was awsm and cutlery was not from the restaurant', 'review_id': 284575892, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868} 2025-03-10 00:39:59 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284444156, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868} 2025-03-10 00:39:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365868&page=1> {'review': '', 'review_id': 284444156, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868} 2025-03-10 00:39:59 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284291060, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868} 2025-03-10 00:39:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365868&page=1> {'review': '', 'review_id': 284291060, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868} 2025-03-10 00:39:59 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284282177, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868} 2025-03-10 00:39:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365868&page=1> {'review': '', 'review_id': 284282177, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Gurgaon ', 'sub_zone': 'AVA Court Mall, South City 2', 'platform': 'zomato', 'res_id': 18365868} 2025-03-10 00:40:03 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:40:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-10 00:40:06 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-10 00:40:06 [scrapy.extensions.logstats] INFO: Crawled 50 pages (at 6 pages/min), scraped 163 items (at 23 items/min) 2025-03-10 00:40:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:40:12 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:40:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:40:15 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567156, 'download_latency': 0.7680065631866455, 'depth': 0} 2025-03-10 00:40:15 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284551632, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882} 2025-03-10 00:40:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365882&page=1> {'review': '', 'review_id': 284551632, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882} 2025-03-10 00:40:15 [reviews] INFO: Scraped item: {'review': 'aftaabi mushroom quantity was too little for this high price, taste also not good', 'review_id': 284150710, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882} 2025-03-10 00:40:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365882&page=1> {'review': 'aftaabi mushroom quantity was too little for this high price, taste also not good', 'review_id': 284150710, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882} 2025-03-10 00:40:15 [reviews] INFO: Scraped item: {'review': 'Very oily and spicy fell sick after consuming the biryani', 'review_id': 283839451, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882} 2025-03-10 00:40:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365882&page=1> {'review': 'Very oily and spicy fell sick after consuming the biryani', 'review_id': 283839451, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882} 2025-03-10 00:40:15 [reviews] INFO: Scraped item: {'review': 'I was not provided with lemon soda in the order. I have been charged for the same ... And nether delivery partner was taking responsibility nor the restaurant!', 'review_id': 283815662, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882} 2025-03-10 00:40:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365882&page=1> {'review': 'I was not provided with lemon soda in the order. I have been charged for the same ... And nether delivery partner was taking responsibility nor the restaurant!', 'review_id': 283815662, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882} 2025-03-10 00:40:15 [reviews] INFO: Scraped item: {'review': 'worst biriyani ', 'review_id': 283586576, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882} 2025-03-10 00:40:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365882&page=1> {'review': 'worst biriyani ', 'review_id': 283586576, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18365882} 2025-03-10 00:40:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:40:20 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567160, 'download_latency': 0.7629132270812988, 'depth': 0} 2025-03-10 00:40:20 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284607805, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897} 2025-03-10 00:40:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365897&page=1> {'review': '', 'review_id': 284607805, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897} 2025-03-10 00:40:20 [reviews] INFO: Scraped item: {'review': 'what a shame
what a scam
pathetic food
micro quantity
tasteless items
supremely disappointed ', 'review_id': 284494240, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897} 2025-03-10 00:40:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365897&page=1> {'review': 'what a shame
what a scam
pathetic food
micro quantity
tasteless items
supremely disappointed ', 'review_id': 284494240, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897} 2025-03-10 00:40:20 [reviews] INFO: Scraped item: {'review': 'Delicious meals perfect for every family. The paneer lababdaar was super tasty. The chicken dish was well cooked and not too spicy and oily, just right. And we regret ordering only 100gm gajar halwa because it was also so tasty. ', 'review_id': 284287327, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897} 2025-03-10 00:40:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365897&page=1> {'review': 'Delicious meals perfect for every family. The paneer lababdaar was super tasty. The chicken dish was well cooked and not too spicy and oily, just right. And we regret ordering only 100gm gajar halwa because it was also so tasty. ', 'review_id': 284287327, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897} 2025-03-10 00:40:20 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284245776, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897} 2025-03-10 00:40:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365897&page=1> {'review': '', 'review_id': 284245776, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897} 2025-03-10 00:40:20 [reviews] INFO: Scraped item: {'review': 'it was not good as it used to be', 'review_id': 283902292, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897} 2025-03-10 00:40:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365897&page=1> {'review': 'it was not good as it used to be', 'review_id': 283902292, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Pushpanjali', 'platform': 'zomato', 'res_id': 18365897} 2025-03-10 00:40:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:40:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:40:26 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18365991, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567169, 'download_latency': 0.9519345760345459, 'depth': 0} 2025-03-10 00:40:26 [reviews] INFO: Scraped item: {'review': 'tasteless. little water like steamed water. very bad experience. ', 'review_id': 284522664, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18365991} 2025-03-10 00:40:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365991&page=1> {'review': 'tasteless. little water like steamed water. very bad experience. ', 'review_id': 284522664, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18365991} 2025-03-10 00:40:26 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284371416, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18365991} 2025-03-10 00:40:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365991&page=1> {'review': '', 'review_id': 284371416, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18365991} 2025-03-10 00:40:26 [reviews] INFO: Scraped item: {'review': 'Test and quality average ๏ฟผ', 'review_id': 283936259, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18365991} 2025-03-10 00:40:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365991&page=1> {'review': 'Test and quality average ๏ฟผ', 'review_id': 283936259, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18365991} 2025-03-10 00:40:26 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283836801, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18365991} 2025-03-10 00:40:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365991&page=1> {'review': '', 'review_id': 283836801, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18365991} 2025-03-10 00:40:26 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283701369, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18365991} 2025-03-10 00:40:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18365991&page=1> {'review': '', 'review_id': 283701369, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18365991} 2025-03-10 00:40:28 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:40:33 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:40:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:40:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:40:43 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:40:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:40:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:40:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:40:55 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18368221, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567196, 'download_latency': 0.7934541702270508, 'depth': 0} 2025-03-10 00:40:55 [reviews] INFO: Scraped item: {'review': 'this is a very bad experience I received the delivery very late as the food became cold now ', 'review_id': 283906761, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18368221} 2025-03-10 00:40:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18368221&page=1> {'review': 'this is a very bad experience I received the delivery very late as the food became cold now ', 'review_id': 283906761, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18368221} 2025-03-10 00:40:55 [reviews] INFO: Scraped item: {'review': 'Too much oil', 'review_id': 283719965, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18368221} 2025-03-10 00:40:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18368221&page=1> {'review': 'Too much oil', 'review_id': 283719965, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18368221} 2025-03-10 00:40:55 [reviews] INFO: Scraped item: {'review': 'The metal handi is a nice touch. But it would be great if you could take it back for reusing. ', 'review_id': 283650701, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18368221} 2025-03-10 00:40:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18368221&page=1> {'review': 'The metal handi is a nice touch. But it would be great if you could take it back for reusing. ', 'review_id': 283650701, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18368221} 2025-03-10 00:40:55 [reviews] INFO: Stopping for res_id: 18368221 as reviews are older than 7 days. 2025-03-10 00:40:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:40:59 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567200, 'download_latency': 0.8506851196289062, 'depth': 0} 2025-03-10 00:40:59 [reviews] INFO: Scraped item: {'review': 'Nothing extra was added only this biryani.. bad.. very bad and cheating ', 'review_id': 284594630, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009} 2025-03-10 00:40:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372009&page=1> {'review': 'Nothing extra was added only this biryani.. bad.. very bad and cheating ', 'review_id': 284594630, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009} 2025-03-10 00:40:59 [reviews] INFO: Scraped item: {'review': 'biryani was too salty ', 'review_id': 284578750, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009} 2025-03-10 00:40:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372009&page=1> {'review': 'biryani was too salty ', 'review_id': 284578750, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009} 2025-03-10 00:40:59 [reviews] INFO: Scraped item: {'review': 'Very less chicken pieces and biryani expensive for the price and what is offered', 'review_id': 284480805, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009} 2025-03-10 00:40:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372009&page=1> {'review': 'Very less chicken pieces and biryani expensive for the price and what is offered', 'review_id': 284480805, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009} 2025-03-10 00:40:59 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283938377, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009} 2025-03-10 00:40:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372009&page=1> {'review': '', 'review_id': 283938377, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009} 2025-03-10 00:40:59 [reviews] INFO: Scraped item: {'review': 'food was good specially haleem. the kebab could have been a bit soft', 'review_id': 283878572, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009} 2025-03-10 00:40:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372009&page=1> {'review': 'food was good specially haleem. the kebab could have been a bit soft', 'review_id': 283878572, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 18372009} 2025-03-10 00:41:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:41:06 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:41:06 [scrapy.extensions.logstats] INFO: Crawled 55 pages (at 5 pages/min), scraped 186 items (at 23 items/min) 2025-03-10 00:41:09 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:41:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:41:13 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567216, 'download_latency': 0.646256685256958, 'depth': 0} 2025-03-10 00:41:13 [reviews] INFO: Scraped item: {'review': 'it was mind-blowing. will definitely order again ', 'review_id': 284459408, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044} 2025-03-10 00:41:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372044&page=1> {'review': 'it was mind-blowing. will definitely order again ', 'review_id': 284459408, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044} 2025-03-10 00:41:13 [reviews] INFO: Scraped item: {'review': 'Taste was not good-.. Specially Paneer-..', 'review_id': 284336540, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044} 2025-03-10 00:41:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372044&page=1> {'review': 'Taste was not good-.. Specially Paneer-..', 'review_id': 284336540, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044} 2025-03-10 00:41:13 [reviews] INFO: Scraped item: {'review': 'as expected very tasty ', 'review_id': 284327876, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044} 2025-03-10 00:41:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372044&page=1> {'review': 'as expected very tasty ', 'review_id': 284327876, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044} 2025-03-10 00:41:13 [reviews] INFO: Scraped item: {'review': "worst biryani and panner ever had even the zomato guys don't respond not the hotel members to hear my issue..the worst biryani don't order", 'review_id': 283767489, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044} 2025-03-10 00:41:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372044&page=1> {'review': "worst biryani and panner ever had even the zomato guys don't respond not the hotel members to hear my issue..the worst biryani don't order", 'review_id': 283767489, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044} 2025-03-10 00:41:13 [reviews] INFO: Scraped item: {'review': 'chicken was stale n smelling.dahi kebab were all burnt', 'review_id': 283688922, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044} 2025-03-10 00:41:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18372044&page=1> {'review': 'chicken was stale n smelling.dahi kebab were all burnt', 'review_id': 283688922, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18372044} 2025-03-10 00:41:15 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:41:19 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:41:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:41:28 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:41:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:41:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:41:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:41:44 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:41:48 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:41:51 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:41:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:42:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:42:00 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567259, 'download_latency': 1.7780187129974365, 'depth': 0} 2025-03-10 00:42:00 [reviews] INFO: Scraped item: {'review': 'ordered paneer tikka but wrong order sent. they sent hariyali kabab :(', 'review_id': 284066891, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663} 2025-03-10 00:42:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18381663&page=1> {'review': 'ordered paneer tikka but wrong order sent. they sent hariyali kabab :(', 'review_id': 284066891, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663} 2025-03-10 00:42:00 [reviews] INFO: Scraped item: {'review': 'no salt', 'review_id': 284039745, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663} 2025-03-10 00:42:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18381663&page=1> {'review': 'no salt', 'review_id': 284039745, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663} 2025-03-10 00:42:00 [reviews] INFO: Scraped item: {'review': 'Waste of money dis', 'review_id': 283380145, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663} 2025-03-10 00:42:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18381663&page=1> {'review': 'Waste of money dis', 'review_id': 283380145, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663} 2025-03-10 00:42:00 [reviews] INFO: Scraped item: {'review': '', 'review_id': 282628451, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663} 2025-03-10 00:42:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18381663&page=1> {'review': '', 'review_id': 282628451, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 22, 'brand_name': 'Khan Chacha - Rolls, Kebabs And Biryani', 'city': 'New Delhi', 'sub_zone': 'Epicuria Food Mall, Nehru Place', 'platform': 'zomato', 'res_id': 18381663} 2025-03-10 00:42:00 [reviews] INFO: Stopping for res_id: 18381663 as reviews are older than 7 days. 2025-03-10 00:42:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:42:04 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:42:06 [scrapy.extensions.logstats] INFO: Crawled 57 pages (at 2 pages/min), scraped 195 items (at 9 items/min) 2025-03-10 00:42:08 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:42:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:42:12 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 56, 'brand_name': 'Noshi - Yum Asian Delivery', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18382342, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567273, 'download_latency': 1.0728058815002441, 'depth': 0} 2025-03-10 00:42:12 [reviews] INFO: Stopping for res_id: 18382342 as reviews are older than 7 days. 2025-03-10 00:42:15 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:42:19 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:42:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:42:26 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:42:31 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:42:35 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:42:38 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:42:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:42:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:42:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:42:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:42:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:43:01 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:43:05 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:43:06 [scrapy.extensions.logstats] INFO: Crawled 58 pages (at 1 pages/min), scraped 195 items (at 0 items/min) 2025-03-10 00:43:09 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:43:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:43:14 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567333, 'download_latency': 1.4848196506500244, 'depth': 0} 2025-03-10 00:43:14 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284523302, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182} 2025-03-10 00:43:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18440182&page=1> {'review': '', 'review_id': 284523302, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182} 2025-03-10 00:43:14 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284487869, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182} 2025-03-10 00:43:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18440182&page=1> {'review': '', 'review_id': 284487869, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182} 2025-03-10 00:43:14 [reviews] INFO: Scraped item: {'review': 'bad packaging ', 'review_id': 284423917, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182} 2025-03-10 00:43:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18440182&page=1> {'review': 'bad packaging ', 'review_id': 284423917, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182} 2025-03-10 00:43:14 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284150676, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182} 2025-03-10 00:43:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18440182&page=1> {'review': '', 'review_id': 284150676, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182} 2025-03-10 00:43:14 [reviews] INFO: Scraped item: {'review': "all the pieces were undercooked. I didn't like the biryani at all. I would have stomach infection eating this.", 'review_id': 284108297, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182} 2025-03-10 00:43:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18440182&page=1> {'review': "all the pieces were undercooked. I didn't like the biryani at all. I would have stomach infection eating this.", 'review_id': 284108297, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Gurgaon ', 'sub_zone': 'Sector 69', 'platform': 'zomato', 'res_id': 18440182} 2025-03-10 00:43:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:43:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:43:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:43:26 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:43:29 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:43:33 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:43:38 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:43:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:43:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:43:49 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:43:52 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:43:57 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:43:59 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:44:03 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:44:06 [scrapy.extensions.logstats] INFO: Crawled 59 pages (at 1 pages/min), scraped 200 items (at 5 items/min) 2025-03-10 00:44:07 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:44:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:44:14 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567395, 'download_latency': 2.8568532466888428, 'depth': 0} 2025-03-10 00:44:14 [reviews] INFO: Scraped item: {'review': 'there were only two pieces of chicken, biryani was almost at cold state .', 'review_id': 284615944, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435} 2025-03-10 00:44:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18466435&page=1> {'review': 'there were only two pieces of chicken, biryani was almost at cold state .', 'review_id': 284615944, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435} 2025-03-10 00:44:14 [reviews] INFO: Scraped item: {'review': 'Express delivery with awesome taste ๐Ÿ˜‰', 'review_id': 284600040, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435} 2025-03-10 00:44:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18466435&page=1> {'review': 'Express delivery with awesome taste ๐Ÿ˜‰', 'review_id': 284600040, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435} 2025-03-10 00:44:14 [reviews] INFO: Scraped item: {'review': 'really bad biryani.
gulam jamun were rock hard.', 'review_id': 284348559, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435} 2025-03-10 00:44:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18466435&page=1> {'review': 'really bad biryani.
gulam jamun were rock hard.', 'review_id': 284348559, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435} 2025-03-10 00:44:14 [reviews] INFO: Scraped item: {'review': 'veg dum biryani burnt not edible at all... sadly has to make alternative food for guests.....not acceptable...very disappointed ', 'review_id': 284219142, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435} 2025-03-10 00:44:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18466435&page=1> {'review': 'veg dum biryani burnt not edible at all... sadly has to make alternative food for guests.....not acceptable...very disappointed ', 'review_id': 284219142, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435} 2025-03-10 00:44:14 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284073093, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435} 2025-03-10 00:44:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18466435&page=1> {'review': '', 'review_id': 284073093, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Shahpur Jat', 'platform': 'zomato', 'res_id': 18466435} 2025-03-10 00:44:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:44:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:44:21 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:44:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:44:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:44:31 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:44:35 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:44:38 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:44:41 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:44:44 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:44:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:44:49 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567433, 'download_latency': 0.9043612480163574, 'depth': 0} 2025-03-10 00:44:49 [reviews] INFO: Scraped item: {'review': 'Too spicy', 'review_id': 284596554, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370} 2025-03-10 00:44:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18535370&page=1> {'review': 'Too spicy', 'review_id': 284596554, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370} 2025-03-10 00:44:49 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284180945, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370} 2025-03-10 00:44:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18535370&page=1> {'review': '', 'review_id': 284180945, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370} 2025-03-10 00:44:49 [reviews] INFO: Scraped item: {'review': "It was very spicy. According to me it shouldn't be this spicy.", 'review_id': 284088902, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370} 2025-03-10 00:44:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18535370&page=1> {'review': "It was very spicy. According to me it shouldn't be this spicy.", 'review_id': 284088902, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370} 2025-03-10 00:44:49 [reviews] INFO: Scraped item: {'review': 'Quantity is very less for this price', 'review_id': 284085753, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370} 2025-03-10 00:44:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18535370&page=1> {'review': 'Quantity is very less for this price', 'review_id': 284085753, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370} 2025-03-10 00:44:49 [reviews] INFO: Scraped item: {'review': 'love the kolkata biryani', 'review_id': 283784492, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370} 2025-03-10 00:44:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18535370&page=1> {'review': 'love the kolkata biryani', 'review_id': 283784492, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 4', 'platform': 'zomato', 'res_id': 18535370} 2025-03-10 00:44:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:44:54 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 55, 'brand_name': 'Enoki - Fresh Asian Kitchen', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18537577, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567437, 'download_latency': 2.1401705741882324, 'depth': 0} 2025-03-10 00:44:54 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284220912, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 55, 'brand_name': 'Enoki - Fresh Asian Kitchen', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18537577} 2025-03-10 00:44:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18537577&page=1> {'review': '', 'review_id': 284220912, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 55, 'brand_name': 'Enoki - Fresh Asian Kitchen', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18537577} 2025-03-10 00:44:54 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284164235, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 55, 'brand_name': 'Enoki - Fresh Asian Kitchen', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18537577} 2025-03-10 00:44:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18537577&page=1> {'review': '', 'review_id': 284164235, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 55, 'brand_name': 'Enoki - Fresh Asian Kitchen', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18537577} 2025-03-10 00:44:54 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284088731, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 55, 'brand_name': 'Enoki - Fresh Asian Kitchen', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18537577} 2025-03-10 00:44:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18537577&page=1> {'review': '', 'review_id': 284088731, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 55, 'brand_name': 'Enoki - Fresh Asian Kitchen', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18537577} 2025-03-10 00:44:54 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283771334, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 55, 'brand_name': 'Enoki - Fresh Asian Kitchen', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18537577} 2025-03-10 00:44:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18537577&page=1> {'review': '', 'review_id': 283771334, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 55, 'brand_name': 'Enoki - Fresh Asian Kitchen', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18537577} 2025-03-10 00:44:54 [reviews] INFO: Scraped item: {'review': 'No avocado or spicy mayo in the bowl !', 'review_id': 282942812, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 55, 'brand_name': 'Enoki - Fresh Asian Kitchen', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18537577} 2025-03-10 00:44:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18537577&page=1> {'review': 'No avocado or spicy mayo in the bowl !', 'review_id': 282942812, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 55, 'brand_name': 'Enoki - Fresh Asian Kitchen', 'city': 'New Delhi', 'sub_zone': 'Greater Kailash 1 (GK1)', 'platform': 'zomato', 'res_id': 18537577} 2025-03-10 00:44:56 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:45:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:45:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:45:04 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 53, 'brand_name': 'Yum Yum Cha', 'city': 'New Delhi', 'sub_zone': 'Khan Market', 'platform': 'zomato', 'res_id': 18544058, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567448, 'download_latency': 0.8187036514282227, 'depth': 0} 2025-03-10 00:45:04 [reviews] INFO: Stopping for res_id: 18544058 as reviews are older than 7 days. 2025-03-10 00:45:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-10 00:45:06 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-10 00:45:06 [scrapy.extensions.logstats] INFO: Crawled 63 pages (at 4 pages/min), scraped 215 items (at 15 items/min) 2025-03-10 00:45:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:45:07 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567454, 'download_latency': 0.8514797687530518, 'depth': 0} 2025-03-10 00:45:07 [reviews] INFO: Scraped item: {'review': 'taste was not soo good , strong fragrance of cinnamon powder ', 'review_id': 284169377, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628} 2025-03-10 00:45:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18547628&page=1> {'review': 'taste was not soo good , strong fragrance of cinnamon powder ', 'review_id': 284169377, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628} 2025-03-10 00:45:07 [reviews] INFO: Scraped item: {'review': 'just like normal rice', 'review_id': 283821355, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628} 2025-03-10 00:45:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18547628&page=1> {'review': 'just like normal rice', 'review_id': 283821355, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628} 2025-03-10 00:45:07 [reviews] INFO: Scraped item: {'review': "It's very bad low quantity of product its not good , full serving please show how much wait or pics you put in full serving bowl", 'review_id': 283229307, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628} 2025-03-10 00:45:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18547628&page=1> {'review': "It's very bad low quantity of product its not good , full serving please show how much wait or pics you put in full serving bowl", 'review_id': 283229307, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628} 2025-03-10 00:45:07 [reviews] INFO: Scraped item: {'review': 'i found biryani best and appreciate their efforts', 'review_id': 283105704, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628} 2025-03-10 00:45:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18547628&page=1> {'review': 'i found biryani best and appreciate their efforts', 'review_id': 283105704, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628} 2025-03-10 00:45:07 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283021052, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628} 2025-03-10 00:45:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18547628&page=1> {'review': '', 'review_id': 283021052, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Kalkaji', 'platform': 'zomato', 'res_id': 18547628} 2025-03-10 00:45:10 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:45:13 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:45:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:45:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:45:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:45:28 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:45:32 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:45:35 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:45:39 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:45:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:45:44 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567484, 'download_latency': 0.9367876052856445, 'depth': 0} 2025-03-10 00:45:44 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284551174, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415} 2025-03-10 00:45:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18575415&page=1> {'review': '', 'review_id': 284551174, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415} 2025-03-10 00:45:44 [reviews] INFO: Scraped item: {'review': 'Nice test ๐Ÿ‘Œ ', 'review_id': 283603408, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415} 2025-03-10 00:45:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18575415&page=1> {'review': 'Nice test ๐Ÿ‘Œ ', 'review_id': 283603408, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415} 2025-03-10 00:45:44 [reviews] INFO: Scraped item: {'review': 'I love your bowls but today sauses in both bowls tasted weird and different.... Not much happy with the taste today.... ', 'review_id': 282726316, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415} 2025-03-10 00:45:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18575415&page=1> {'review': 'I love your bowls but today sauses in both bowls tasted weird and different.... Not much happy with the taste today.... ', 'review_id': 282726316, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 44, 'brand_name': 'Lollo Rosso', 'city': 'Ahmedabad ', 'sub_zone': 'Naranpura', 'platform': 'zomato', 'res_id': 18575415} 2025-03-10 00:45:44 [reviews] INFO: Stopping for res_id: 18575415 as reviews are older than 7 days. 2025-03-10 00:45:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:45:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:45:50 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567489, 'download_latency': 3.2741026878356934, 'depth': 0} 2025-03-10 00:45:50 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284501145, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108} 2025-03-10 00:45:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18577108&page=1> {'review': '', 'review_id': 284501145, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108} 2025-03-10 00:45:50 [reviews] INFO: Scraped item: {'review': 'The duck was cooked very well and paired very well with the sauces. The dimsums and sushi was made very well and the choice of sauces with all the food was excellent.
Swapan our server was extremely helpful and proved great at suggestions for the food, thank you!', 'review_id': 283730811, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108} 2025-03-10 00:45:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18577108&page=1> {'review': 'The duck was cooked very well and paired very well with the sauces. The dimsums and sushi was made very well and the choice of sauces with all the food was excellent.
Swapan our server was extremely helpful and proved great at suggestions for the food, thank you!', 'review_id': 283730811, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108} 2025-03-10 00:45:50 [reviews] INFO: Scraped item: {'review': 'sushi was cold', 'review_id': 282730847, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108} 2025-03-10 00:45:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18577108&page=1> {'review': 'sushi was cold', 'review_id': 282730847, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 50, 'brand_name': "Ping's Cafe Orient", 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18577108} 2025-03-10 00:45:50 [reviews] INFO: Stopping for res_id: 18577108 as reviews are older than 7 days. 2025-03-10 00:45:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:45:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:46:01 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:46:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:46:05 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567508, 'download_latency': 0.8456592559814453, 'depth': 0} 2025-03-10 00:46:05 [reviews] INFO: Scraped item: {'review': 'Absolutely flavourless', 'review_id': 283808692, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428} 2025-03-10 00:46:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582428&page=1> {'review': 'Absolutely flavourless', 'review_id': 283808692, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428} 2025-03-10 00:46:05 [reviews] INFO: Scraped item: {'review': 'Too good', 'review_id': 283774200, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428} 2025-03-10 00:46:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582428&page=1> {'review': 'Too good', 'review_id': 283774200, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428} 2025-03-10 00:46:05 [reviews] INFO: Scraped item: {'review': 'Biryani was burnt, it tasted so bitter, had to throw away all the food', 'review_id': 283317881, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428} 2025-03-10 00:46:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582428&page=1> {'review': 'Biryani was burnt, it tasted so bitter, had to throw away all the food', 'review_id': 283317881, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428} 2025-03-10 00:46:05 [reviews] INFO: Scraped item: {'review': 'Awesome Biryani Loved it...!!', 'review_id': 283235823, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428} 2025-03-10 00:46:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582428&page=1> {'review': 'Awesome Biryani Loved it...!!', 'review_id': 283235823, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428} 2025-03-10 00:46:05 [reviews] INFO: Scraped item: {'review': "where is the Gajar ka halwa?
I had paid for that and haven't received ", 'review_id': 283227359, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428} 2025-03-10 00:46:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582428&page=1> {'review': "where is the Gajar ka halwa?
I had paid for that and haven't received ", 'review_id': 283227359, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 18582428} 2025-03-10 00:46:06 [scrapy.extensions.logstats] INFO: Crawled 67 pages (at 4 pages/min), scraped 231 items (at 16 items/min) 2025-03-10 00:46:09 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:46:13 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:46:17 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:46:21 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:46:25 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:46:28 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:46:33 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:46:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:46:38 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567536, 'download_latency': 1.6836678981781006, 'depth': 0} 2025-03-10 00:46:38 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284455444, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431} 2025-03-10 00:46:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582431&page=1> {'review': '', 'review_id': 284455444, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431} 2025-03-10 00:46:38 [reviews] INFO: Scraped item: {'review': "I didn't received my gajar ka halwa", 'review_id': 284272445, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431} 2025-03-10 00:46:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582431&page=1> {'review': "I didn't received my gajar ka halwa", 'review_id': 284272445, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431} 2025-03-10 00:46:38 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283665290, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431} 2025-03-10 00:46:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582431&page=1> {'review': '', 'review_id': 283665290, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431} 2025-03-10 00:46:38 [reviews] INFO: Scraped item: {'review': 'delicious ', 'review_id': 283548219, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431} 2025-03-10 00:46:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582431&page=1> {'review': 'delicious ', 'review_id': 283548219, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431} 2025-03-10 00:46:38 [reviews] INFO: Scraped item: {'review': 'Only one small chicken piece was there in the biryani. Considering the cost, portion of biryani was not adequate', 'review_id': 282992715, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431} 2025-03-10 00:46:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18582431&page=1> {'review': 'Only one small chicken piece was there in the biryani. Considering the cost, portion of biryani was not adequate', 'review_id': 282992715, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18582431} 2025-03-10 00:46:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:46:41 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 0, 'brand_name': 'La Veggie', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 18628825, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567540, 'download_latency': 1.1557676792144775, 'depth': 0} 2025-03-10 00:46:41 [reviews] INFO: Scraped item: {'review': 'This is a family restaurant near Chowpatty.
Appropriate for large guests as well, i have been twice with my entire family of 12-15 people.

The staff was always attentive to the table and was quick. The food was great taste and a wide jain menu is available. If you are not comfortable with spicy food please do mention to the staff to make the food less spicy.

They have good food for the pricing.
The laska soup is coconut based soup and very nice.
In starters we really enjoyed the jain crispy vegetables and cheese marbles.

They have valet parking available too.', 'review_id': 284608676, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 0, 'brand_name': 'La Veggie', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 18628825} 2025-03-10 00:46:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18628825&page=1> {'review': 'This is a family restaurant near Chowpatty.
Appropriate for large guests as well, i have been twice with my entire family of 12-15 people.

The staff was always attentive to the table and was quick. The food was great taste and a wide jain menu is available. If you are not comfortable with spicy food please do mention to the staff to make the food less spicy.

They have good food for the pricing.
The laska soup is coconut based soup and very nice.
In starters we really enjoyed the jain crispy vegetables and cheese marbles.

They have valet parking available too.', 'review_id': 284608676, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 0, 'brand_name': 'La Veggie', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 18628825} 2025-03-10 00:46:41 [reviews] INFO: Scraped item: {'review': '', 'review_id': 282485654, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 0, 'brand_name': 'La Veggie', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 18628825} 2025-03-10 00:46:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18628825&page=1> {'review': '', 'review_id': 282485654, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 0, 'brand_name': 'La Veggie', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 18628825} 2025-03-10 00:46:41 [reviews] INFO: Stopping for res_id: 18628825 as reviews are older than 7 days. 2025-03-10 00:46:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:46:43 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'New Delhi', 'sub_zone': 'Defence Colony', 'platform': 'zomato', 'res_id': 18632303, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567544, 'download_latency': 0.6994531154632568, 'depth': 0} 2025-03-10 00:46:43 [reviews] INFO: Stopping for res_id: 18632303 as reviews are older than 7 days. 2025-03-10 00:46:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:46:46 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 49, 'brand_name': 'Pa Pa Ya', 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18650200, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567550, 'download_latency': 0.7136533260345459, 'depth': 0} 2025-03-10 00:46:46 [reviews] INFO: Scraped item: {'review': 'Nasi goreng was supposed to be less spicy as mentioned in the cooking instructions', 'review_id': 284054753, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 49, 'brand_name': 'Pa Pa Ya', 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18650200} 2025-03-10 00:46:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18650200&page=1> {'review': 'Nasi goreng was supposed to be less spicy as mentioned in the cooking instructions', 'review_id': 284054753, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 49, 'brand_name': 'Pa Pa Ya', 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18650200} 2025-03-10 00:46:46 [reviews] INFO: Scraped item: {'review': 'Simply breathtaking views. beautiful ambience, polite staff and out of the world experience with food ! ', 'review_id': 283976824, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 49, 'brand_name': 'Pa Pa Ya', 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18650200} 2025-03-10 00:46:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18650200&page=1> {'review': 'Simply breathtaking views. beautiful ambience, polite staff and out of the world experience with food ! ', 'review_id': 283976824, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 49, 'brand_name': 'Pa Pa Ya', 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18650200} 2025-03-10 00:46:46 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283252611, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 49, 'brand_name': 'Pa Pa Ya', 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18650200} 2025-03-10 00:46:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18650200&page=1> {'review': '', 'review_id': 283252611, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 49, 'brand_name': 'Pa Pa Ya', 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18650200} 2025-03-10 00:46:46 [reviews] INFO: Scraped item: {'review': 'Spectacular food, great service with a great view!', 'review_id': 283233385, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-06', 'competitor_id': 49, 'brand_name': 'Pa Pa Ya', 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18650200} 2025-03-10 00:46:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18650200&page=1> {'review': 'Spectacular food, great service with a great view!', 'review_id': 283233385, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-06', 'competitor_id': 49, 'brand_name': 'Pa Pa Ya', 'city': 'Kolkata', 'sub_zone': 'Park Street Area', 'platform': 'zomato', 'res_id': 18650200} 2025-03-10 00:46:46 [reviews] INFO: Stopping for res_id: 18650200 as reviews are older than 7 days. 2025-03-10 00:46:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:46:55 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:46:58 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:47:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:47:02 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567562, 'download_latency': 0.6789050102233887, 'depth': 0} 2025-03-10 00:47:02 [reviews] INFO: Scraped item: {'review': 'decent enough taste, but the tandoori chicken was a bit dry and hard', 'review_id': 284461700, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316} 2025-03-10 00:47:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18658316&page=1> {'review': 'decent enough taste, but the tandoori chicken was a bit dry and hard', 'review_id': 284461700, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316} 2025-03-10 00:47:02 [reviews] INFO: Scraped item: {'review': 'Mohit and Avnit were very welcoming and helpful hosts. thanks for this lunch.', 'review_id': 284406434, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316} 2025-03-10 00:47:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18658316&page=1> {'review': 'Mohit and Avnit were very welcoming and helpful hosts. thanks for this lunch.', 'review_id': 284406434, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316} 2025-03-10 00:47:02 [reviews] INFO: Scraped item: {'review': 'not proper cooked and vry bad experience...for the fst time...', 'review_id': 283979548, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316} 2025-03-10 00:47:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18658316&page=1> {'review': 'not proper cooked and vry bad experience...for the fst time...', 'review_id': 283979548, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316} 2025-03-10 00:47:02 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283924135, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316} 2025-03-10 00:47:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18658316&page=1> {'review': '', 'review_id': 283924135, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316} 2025-03-10 00:47:02 [reviews] INFO: Scraped item: {'review': 'very good food and ambience, Mohit bisht hosted us pretty well, kudos to the team', 'review_id': 283914532, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316} 2025-03-10 00:47:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18658316&page=1> {'review': 'very good food and ambience, Mohit bisht hosted us pretty well, kudos to the team', 'review_id': 283914532, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Connaught Place', 'platform': 'zomato', 'res_id': 18658316} 2025-03-10 00:47:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:47:06 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567566, 'download_latency': 0.7522807121276855, 'depth': 0} 2025-03-10 00:47:06 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284618914, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842} 2025-03-10 00:47:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18665842&page=1> {'review': '', 'review_id': 284618914, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842} 2025-03-10 00:47:06 [reviews] INFO: Scraped item: {'review': 'chiken biryani test was not good', 'review_id': 284400352, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842} 2025-03-10 00:47:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18665842&page=1> {'review': 'chiken biryani test was not good', 'review_id': 284400352, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842} 2025-03-10 00:47:06 [reviews] INFO: Scraped item: {'review': 'Very tasty and spicy ', 'review_id': 283618707, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842} 2025-03-10 00:47:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18665842&page=1> {'review': 'Very tasty and spicy ', 'review_id': 283618707, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842} 2025-03-10 00:47:06 [reviews] INFO: Scraped item: {'review': 'Instead of making it spicy, crispy and chilli was sweet. Mood kharab hogaya.', 'review_id': 283618052, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842} 2025-03-10 00:47:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18665842&page=1> {'review': 'Instead of making it spicy, crispy and chilli was sweet. Mood kharab hogaya.', 'review_id': 283618052, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842} 2025-03-10 00:47:06 [reviews] INFO: Scraped item: {'review': 'I ordered Chicken Schezwan Fried Rice, but they sent me Veg Schezwan Fried Rice instead. Despite reaching out to Zomato support with pictures and videos, the issue remained unresolved. Disappointed with the service and lack of attention to order accuracy.', 'review_id': 282687558, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842} 2025-03-10 00:47:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18665842&page=1> {'review': 'I ordered Chicken Schezwan Fried Rice, but they sent me Veg Schezwan Fried Rice instead. Despite reaching out to Zomato support with pictures and videos, the issue remained unresolved. Disappointed with the service and lack of attention to order accuracy.', 'review_id': 282687558, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 60, 'brand_name': 'Ravi Chinese', 'city': 'Navi Mumbai', 'sub_zone': 'Nerul', 'platform': 'zomato', 'res_id': 18665842} 2025-03-10 00:47:06 [scrapy.extensions.logstats] INFO: Crawled 73 pages (at 6 pages/min), scraped 252 items (at 21 items/min) 2025-03-10 00:47:09 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:47:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:47:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:47:21 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:47:24 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:47:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:47:29 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18669449, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567589, 'download_latency': 0.7211196422576904, 'depth': 0} 2025-03-10 00:47:29 [reviews] INFO: Scraped item: {'review': 'Not Good', 'review_id': 284389236, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18669449} 2025-03-10 00:47:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18669449&page=1> {'review': 'Not Good', 'review_id': 284389236, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18669449} 2025-03-10 00:47:29 [reviews] INFO: Scraped item: {'review': 'too little quantity, rice not in proportion with gravy, too spicy. not value for money at all', 'review_id': 284353974, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18669449} 2025-03-10 00:47:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18669449&page=1> {'review': 'too little quantity, rice not in proportion with gravy, too spicy. not value for money at all', 'review_id': 284353974, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18669449} 2025-03-10 00:47:29 [reviews] INFO: Scraped item: {'review': 'it was very bland and was saltless..we did not expected this frm behrouz', 'review_id': 284168454, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18669449} 2025-03-10 00:47:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18669449&page=1> {'review': 'it was very bland and was saltless..we did not expected this frm behrouz', 'review_id': 284168454, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18669449} 2025-03-10 00:47:29 [reviews] INFO: Scraped item: {'review': 'Haleem was not authentic', 'review_id': 283734123, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18669449} 2025-03-10 00:47:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18669449&page=1> {'review': 'Haleem was not authentic', 'review_id': 283734123, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18669449} 2025-03-10 00:47:29 [reviews] INFO: Stopping for res_id: 18669449 as reviews are older than 7 days. 2025-03-10 00:47:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:47:32 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567593, 'download_latency': 1.0448417663574219, 'depth': 0} 2025-03-10 00:47:32 [reviews] INFO: Scraped item: {'review': 'You charge so high for the peices of bones in Nihari? Rubbish never will order again. ', 'review_id': 284196878, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791} 2025-03-10 00:47:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18670791&page=1> {'review': 'You charge so high for the peices of bones in Nihari? Rubbish never will order again. ', 'review_id': 284196878, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791} 2025-03-10 00:47:32 [reviews] INFO: Scraped item: {'review': 'portion is very small and rates are very high. very disappointing quantity of mutton nihari ', 'review_id': 284067441, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791} 2025-03-10 00:47:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18670791&page=1> {'review': 'portion is very small and rates are very high. very disappointing quantity of mutton nihari ', 'review_id': 284067441, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791} 2025-03-10 00:47:32 [reviews] INFO: Scraped item: {'review': "terrible quantity, can't feed one person.", 'review_id': 283795860, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791} 2025-03-10 00:47:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18670791&page=1> {'review': "terrible quantity, can't feed one person.", 'review_id': 283795860, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791} 2025-03-10 00:47:32 [reviews] INFO: Scraped item: {'review': 'lolly was stinking, why do u ppl waste our money.. extremely annoyed... ', 'review_id': 283635998, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791} 2025-03-10 00:47:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18670791&page=1> {'review': 'lolly was stinking, why do u ppl waste our money.. extremely annoyed... ', 'review_id': 283635998, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791} 2025-03-10 00:47:32 [reviews] INFO: Scraped item: {'review': 'The food was extremely oily and very spicy also the fried rice had hair in it only thing that was good was the falooda', 'review_id': 283405287, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791} 2025-03-10 00:47:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18670791&page=1> {'review': 'The food was extremely oily and very spicy also the fried rice had hair in it only thing that was good was the falooda', 'review_id': 283405287, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 5, 'brand_name': 'Shalimar', 'city': 'Mumbai', 'sub_zone': 'Jogeshwari', 'platform': 'zomato', 'res_id': 18670791} 2025-03-10 00:47:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:47:37 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567598, 'download_latency': 2.3226027488708496, 'depth': 0} 2025-03-10 00:47:37 [reviews] INFO: Scraped item: {'review': 'rice quantity very less ', 'review_id': 284599855, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928} 2025-03-10 00:47:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18687928&page=1> {'review': 'rice quantity very less ', 'review_id': 284599855, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928} 2025-03-10 00:47:37 [reviews] INFO: Scraped item: {'review': 'Wrost service', 'review_id': 284156655, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928} 2025-03-10 00:47:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18687928&page=1> {'review': 'Wrost service', 'review_id': 284156655, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928} 2025-03-10 00:47:37 [reviews] INFO: Scraped item: {'review': 'A huge disappointment for my family, as we used to love behrouz biryani but now taste has changed so much that it feels like a waste of money

especially Haleem it taste is now๐Ÿคฎ, will never recommend behrouz to anyone from now.', 'review_id': 283994518, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928} 2025-03-10 00:47:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18687928&page=1> {'review': 'A huge disappointment for my family, as we used to love behrouz biryani but now taste has changed so much that it feels like a waste of money

especially Haleem it taste is now๐Ÿคฎ, will never recommend behrouz to anyone from now.', 'review_id': 283994518, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928} 2025-03-10 00:47:37 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283924791, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928} 2025-03-10 00:47:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18687928&page=1> {'review': '', 'review_id': 283924791, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928} 2025-03-10 00:47:37 [reviews] INFO: Scraped item: {'review': 'the masala was burnt in aftaabi murgh tikka masala, it taste was not good ', 'review_id': 283694240, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928} 2025-03-10 00:47:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18687928&page=1> {'review': 'the masala was burnt in aftaabi murgh tikka masala, it taste was not good ', 'review_id': 283694240, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 18687928} 2025-03-10 00:47:39 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:47:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:47:44 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 18729345, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567603, 'download_latency': 0.8604114055633545, 'depth': 0} 2025-03-10 00:47:44 [reviews] INFO: Scraped item: {'review': 'A lot of masala was there in the biriyani with less chicken pieces. It felt as if the chicken was compensated with additional masala. Overall the experience was pathetic and not up to the mark.', 'review_id': 284333247, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 18729345} 2025-03-10 00:47:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18729345&page=1> {'review': 'A lot of masala was there in the biriyani with less chicken pieces. It felt as if the chicken was compensated with additional masala. Overall the experience was pathetic and not up to the mark.', 'review_id': 284333247, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 18729345} 2025-03-10 00:47:44 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283369148, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 18729345} 2025-03-10 00:47:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18729345&page=1> {'review': '', 'review_id': 283369148, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 18729345} 2025-03-10 00:47:44 [reviews] INFO: Scraped item: {'review': 'rice was not good and chicken was stale', 'review_id': 283142686, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 18729345} 2025-03-10 00:47:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18729345&page=1> {'review': 'rice was not good and chicken was stale', 'review_id': 283142686, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 18729345} 2025-03-10 00:47:44 [reviews] INFO: Scraped item: {'review': 'food was delivered cold ', 'review_id': 282703612, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 18729345} 2025-03-10 00:47:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18729345&page=1> {'review': 'food was delivered cold ', 'review_id': 282703612, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 18729345} 2025-03-10 00:47:44 [reviews] INFO: Stopping for res_id: 18729345 as reviews are older than 7 days. 2025-03-10 00:47:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:47:49 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai ', 'sub_zone': 'Palladium Mall, Lower Parel', 'platform': 'zomato', 'res_id': 18733959, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567607, 'download_latency': 1.324077844619751, 'depth': 0} 2025-03-10 00:47:49 [reviews] INFO: Stopping for res_id: 18733959 as reviews are older than 7 days. 2025-03-10 00:47:52 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:47:55 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:48:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:48:01 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567618, 'download_latency': 1.0731844902038574, 'depth': 0} 2025-03-10 00:48:01 [reviews] INFO: Scraped item: {'review': 'Tried the Ramadan specials for delivery, and the experience was outstanding! The dishes were delicious and arrived hot and fresh, making Iftar truly enjoyable', 'review_id': 284602433, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687} 2025-03-10 00:48:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18735687&page=1> {'review': 'Tried the Ramadan specials for delivery, and the experience was outstanding! The dishes were delicious and arrived hot and fresh, making Iftar truly enjoyable', 'review_id': 284602433, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687} 2025-03-10 00:48:01 [reviews] INFO: Scraped item: {'review': 'perplexed if i ordered kebabs or burnt kebabs', 'review_id': 284592218, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687} 2025-03-10 00:48:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18735687&page=1> {'review': 'perplexed if i ordered kebabs or burnt kebabs', 'review_id': 284592218, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687} 2025-03-10 00:48:01 [reviews] INFO: Scraped item: {'review': 'Tried the Ramadan specials for delivery, and the experience was wonderful! The dishes were hot and fresh with generous portions that made Iftar truly satisfying.', 'review_id': 284583727, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687} 2025-03-10 00:48:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18735687&page=1> {'review': 'Tried the Ramadan specials for delivery, and the experience was wonderful! The dishes were hot and fresh with generous portions that made Iftar truly satisfying.', 'review_id': 284583727, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687} 2025-03-10 00:48:01 [reviews] INFO: Scraped item: {'review': 'Ordered Iftar from the Ramadan menu, and it was a great choice! The food was fresh and flavorful, with safe packaging that kept everything warm and intact', 'review_id': 284540862, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687} 2025-03-10 00:48:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18735687&page=1> {'review': 'Ordered Iftar from the Ramadan menu, and it was a great choice! The food was fresh and flavorful, with safe packaging that kept everything warm and intact', 'review_id': 284540862, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687} 2025-03-10 00:48:01 [reviews] INFO: Scraped item: {'review': 'Ordered the Ramadan Iftar specials, and it was a delightful experience! The food was fresh with authentic flavors, and the safe packaging kept everything warm and secure.', 'review_id': 284475459, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687} 2025-03-10 00:48:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18735687&page=1> {'review': 'Ordered the Ramadan Iftar specials, and it was a delightful experience! The food was fresh with authentic flavors, and the safe packaging kept everything warm and secure.', 'review_id': 284475459, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Kurla', 'platform': 'zomato', 'res_id': 18735687} 2025-03-10 00:48:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:48:04 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567622, 'download_latency': 0.8521327972412109, 'depth': 0} 2025-03-10 00:48:04 [reviews] INFO: Scraped item: {'review': 'Pathetic experience, it was very messy', 'review_id': 284054061, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991} 2025-03-10 00:48:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18746991&page=1> {'review': 'Pathetic experience, it was very messy', 'review_id': 284054061, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991} 2025-03-10 00:48:04 [reviews] INFO: Scraped item: {'review': 'Food was really good. No doubt ', 'review_id': 283922130, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991} 2025-03-10 00:48:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18746991&page=1> {'review': 'Food was really good. No doubt ', 'review_id': 283922130, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991} 2025-03-10 00:48:04 [reviews] INFO: Scraped item: {'review': 'Very poor quality packing. Dal was packed in paper container which deteriorated and entire dal spilled on opening.', 'review_id': 283648909, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991} 2025-03-10 00:48:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18746991&page=1> {'review': 'Very poor quality packing. Dal was packed in paper container which deteriorated and entire dal spilled on opening.', 'review_id': 283648909, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991} 2025-03-10 00:48:04 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283090302, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991} 2025-03-10 00:48:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18746991&page=1> {'review': '', 'review_id': 283090302, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991} 2025-03-10 00:48:04 [reviews] INFO: Scraped item: {'review': 'They did not send stand and candles for matki to keep it hot', 'review_id': 283053818, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991} 2025-03-10 00:48:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18746991&page=1> {'review': 'They did not send stand and candles for matki to keep it hot', 'review_id': 283053818, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 18746991} 2025-03-10 00:48:06 [scrapy.extensions.logstats] INFO: Crawled 80 pages (at 7 pages/min), scraped 280 items (at 28 items/min) 2025-03-10 00:48:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:48:12 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:48:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:48:19 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:48:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:48:25 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:48:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:48:30 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567649, 'download_latency': 0.6852607727050781, 'depth': 0} 2025-03-10 00:48:30 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284599258, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110} 2025-03-10 00:48:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18780110&page=1> {'review': '', 'review_id': 284599258, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110} 2025-03-10 00:48:30 [reviews] INFO: Scraped item: {'review': 'delayed by half an hour ', 'review_id': 284547192, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110} 2025-03-10 00:48:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18780110&page=1> {'review': 'delayed by half an hour ', 'review_id': 284547192, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110} 2025-03-10 00:48:30 [reviews] INFO: Scraped item: {'review': 'Quality is not good', 'review_id': 284148956, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110} 2025-03-10 00:48:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18780110&page=1> {'review': 'Quality is not good', 'review_id': 284148956, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110} 2025-03-10 00:48:30 [reviews] INFO: Scraped item: {'review': 'Ausome food', 'review_id': 283793119, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110} 2025-03-10 00:48:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18780110&page=1> {'review': 'Ausome food', 'review_id': 283793119, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110} 2025-03-10 00:48:30 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283459979, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110} 2025-03-10 00:48:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18780110&page=1> {'review': '', 'review_id': 283459979, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 18780110} 2025-03-10 00:48:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:48:33 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Navi Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 18789443, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567653, 'download_latency': 1.2851901054382324, 'depth': 0} 2025-03-10 00:48:33 [reviews] INFO: Scraped item: {'review': 'received veg hakka noodles instead of chicken noodles, veggies were chopped in large pieces ', 'review_id': 284334493, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Navi Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 18789443} 2025-03-10 00:48:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18789443&page=1> {'review': 'received veg hakka noodles instead of chicken noodles, veggies were chopped in large pieces ', 'review_id': 284334493, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Navi Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 18789443} 2025-03-10 00:48:33 [reviews] INFO: Scraped item: {'review': 'food overall here is good and delicious..', 'review_id': 283857595, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Navi Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 18789443} 2025-03-10 00:48:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18789443&page=1> {'review': 'food overall here is good and delicious..', 'review_id': 283857595, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Navi Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 18789443} 2025-03-10 00:48:33 [reviews] INFO: Scraped item: {'review': 'Vegetable might be chopped smaller.', 'review_id': 283536540, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Navi Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 18789443} 2025-03-10 00:48:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18789443&page=1> {'review': 'Vegetable might be chopped smaller.', 'review_id': 283536540, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Navi Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 18789443} 2025-03-10 00:48:33 [reviews] INFO: Stopping for res_id: 18789443 as reviews are older than 7 days. 2025-03-10 00:48:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:48:38 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:48:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:48:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:48:45 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567669, 'download_latency': 1.6169006824493408, 'depth': 0} 2025-03-10 00:48:45 [reviews] INFO: Scraped item: {'review': 'one item was missing ', 'review_id': 283893684, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648} 2025-03-10 00:48:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18806648&page=1> {'review': 'one item was missing ', 'review_id': 283893684, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648} 2025-03-10 00:48:45 [reviews] INFO: Scraped item: {'review': "doesn't look fresh at all order at 1 30 am", 'review_id': 283796201, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648} 2025-03-10 00:48:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18806648&page=1> {'review': "doesn't look fresh at all order at 1 30 am", 'review_id': 283796201, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648} 2025-03-10 00:48:45 [reviews] INFO: Scraped item: {'review': 'too salty ', 'review_id': 283525880, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648} 2025-03-10 00:48:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18806648&page=1> {'review': 'too salty ', 'review_id': 283525880, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648} 2025-03-10 00:48:45 [reviews] INFO: Scraped item: {'review': 'ordered handi biryani, but get biryani in a box.. Not satisfied', 'review_id': 283420082, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648} 2025-03-10 00:48:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18806648&page=1> {'review': 'ordered handi biryani, but get biryani in a box.. Not satisfied', 'review_id': 283420082, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648} 2025-03-10 00:48:45 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283417796, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648} 2025-03-10 00:48:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18806648&page=1> {'review': '', 'review_id': 283417796, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 18806648} 2025-03-10 00:48:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:48:48 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:48:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:48:51 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567681, 'download_latency': 0.7540767192840576, 'depth': 0} 2025-03-10 00:48:51 [reviews] INFO: Scraped item: {'review': 'Always satisfying', 'review_id': 284450486, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839} 2025-03-10 00:48:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18852839&page=1> {'review': 'Always satisfying', 'review_id': 284450486, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839} 2025-03-10 00:48:51 [reviews] INFO: Scraped item: {'review': 'No taste and they mixed extra colours. That is not good for health and harm', 'review_id': 284351998, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839} 2025-03-10 00:48:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18852839&page=1> {'review': 'No taste and they mixed extra colours. That is not good for health and harm', 'review_id': 284351998, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839} 2025-03-10 00:48:51 [reviews] INFO: Scraped item: {'review': "Hello, I contacted the restaurant to make sure the instructions I had given for the chef to not make the food spicy were followed. The customer care representative assured me that he had talked to the chef and that I need not worry about the food being spicy due to my gut issues. needless to say the food was delivered but extremely spicy... I couldn't even eat it, had to toss it. very unfortunate that instructions were not followed. ", 'review_id': 284102878, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839} 2025-03-10 00:48:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18852839&page=1> {'review': "Hello, I contacted the restaurant to make sure the instructions I had given for the chef to not make the food spicy were followed. The customer care representative assured me that he had talked to the chef and that I need not worry about the food being spicy due to my gut issues. needless to say the food was delivered but extremely spicy... I couldn't even eat it, had to toss it. very unfortunate that instructions were not followed. ", 'review_id': 284102878, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839} 2025-03-10 00:48:51 [reviews] INFO: Scraped item: {'review': 'super good. good quantity, good taste', 'review_id': 284016744, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839} 2025-03-10 00:48:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18852839&page=1> {'review': 'super good. good quantity, good taste', 'review_id': 284016744, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839} 2025-03-10 00:48:51 [reviews] INFO: Scraped item: {'review': 'too much spicy and bad taste ', 'review_id': 283768120, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839} 2025-03-10 00:48:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18852839&page=1> {'review': 'too much spicy and bad taste ', 'review_id': 283768120, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 18852839} 2025-03-10 00:48:53 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:48:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:49:01 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:49:05 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:49:06 [scrapy.extensions.logstats] INFO: Crawled 84 pages (at 4 pages/min), scraped 298 items (at 18 items/min) 2025-03-10 00:49:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:49:10 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:49:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:49:17 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:49:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:49:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:49:28 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:49:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:49:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:49:34 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 18887194, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567726, 'download_latency': 0.7716379165649414, 'depth': 0} 2025-03-10 00:49:34 [reviews] INFO: Scraped item: {'review': 'It is stale and getting fish oil smell, please arrange for a refund.', 'review_id': 284614538, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 18887194} 2025-03-10 00:49:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18887194&page=1> {'review': 'It is stale and getting fish oil smell, please arrange for a refund.', 'review_id': 284614538, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 18887194} 2025-03-10 00:49:34 [reviews] INFO: Scraped item: {'review': "taste quality n quantity all very amazing it's my go to for all cravings", 'review_id': 284610145, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 18887194} 2025-03-10 00:49:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18887194&page=1> {'review': "taste quality n quantity all very amazing it's my go to for all cravings", 'review_id': 284610145, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 18887194} 2025-03-10 00:49:34 [reviews] INFO: Scraped item: {'review': 'Good ', 'review_id': 284600550, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 18887194} 2025-03-10 00:49:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18887194&page=1> {'review': 'Good ', 'review_id': 284600550, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 18887194} 2025-03-10 00:49:34 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284597392, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 18887194} 2025-03-10 00:49:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18887194&page=1> {'review': '', 'review_id': 284597392, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 18887194} 2025-03-10 00:49:34 [reviews] INFO: Scraped item: {'review': 'very disappointing.. the chicken was stale, it was tough to eat, our money was wasted', 'review_id': 284568970, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 18887194} 2025-03-10 00:49:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18887194&page=1> {'review': 'very disappointing.. the chicken was stale, it was tough to eat, our money was wasted', 'review_id': 284568970, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 18887194} 2025-03-10 00:49:38 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:49:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:49:45 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:49:48 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:49:52 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:49:55 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:50:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:50:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:50:06 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:50:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-10 00:50:06 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-10 00:50:06 [scrapy.extensions.logstats] INFO: Crawled 85 pages (at 1 pages/min), scraped 303 items (at 5 items/min) 2025-03-10 00:50:09 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:50:12 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:50:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:50:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:50:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:50:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:50:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:50:34 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567775, 'download_latency': 2.658989667892456, 'depth': 0} 2025-03-10 00:50:34 [reviews] INFO: Scraped item: {'review': 'Nothing but just rice and pieces of chicken/mutton', 'review_id': 284627549, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094} 2025-03-10 00:50:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18934094&page=1> {'review': 'Nothing but just rice and pieces of chicken/mutton', 'review_id': 284627549, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094} 2025-03-10 00:50:34 [reviews] INFO: Scraped item: {'review': 'Good taste', 'review_id': 284577597, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094} 2025-03-10 00:50:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18934094&page=1> {'review': 'Good taste', 'review_id': 284577597, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094} 2025-03-10 00:50:34 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284415211, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094} 2025-03-10 00:50:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18934094&page=1> {'review': '', 'review_id': 284415211, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094} 2025-03-10 00:50:34 [reviews] INFO: Scraped item: {'review': 'very good ', 'review_id': 284280797, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094} 2025-03-10 00:50:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18934094&page=1> {'review': 'very good ', 'review_id': 284280797, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094} 2025-03-10 00:50:34 [reviews] INFO: Scraped item: {'review': 'Too too spicy and what were curry leaves doing in hyderabadi biryani? ', 'review_id': 284258834, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094} 2025-03-10 00:50:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18934094&page=1> {'review': 'Too too spicy and what were curry leaves doing in hyderabadi biryani? ', 'review_id': 284258834, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'DDA Market', 'platform': 'zomato', 'res_id': 18934094} 2025-03-10 00:50:35 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:50:38 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:50:41 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:50:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:50:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:50:53 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:50:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:51:01 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:51:05 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:51:06 [scrapy.extensions.logstats] INFO: Crawled 86 pages (at 1 pages/min), scraped 308 items (at 5 items/min) 2025-03-10 00:51:10 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:51:12 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:51:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:51:21 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:51:23 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:51:26 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:51:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:51:32 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 71, 'brand_name': "Raju's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18939360, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567834, 'download_latency': 1.6151769161224365, 'depth': 0} 2025-03-10 00:51:32 [reviews] INFO: Scraped item: {'review': 'Added colour even after requesting', 'review_id': 283395400, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 71, 'brand_name': "Raju's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18939360} 2025-03-10 00:51:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18939360&page=1> {'review': 'Added colour even after requesting', 'review_id': 283395400, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 71, 'brand_name': "Raju's Kitchen", 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 18939360} 2025-03-10 00:51:32 [reviews] INFO: Stopping for res_id: 18939360 as reviews are older than 7 days. 2025-03-10 00:51:33 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:51:38 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:51:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:51:45 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:51:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:51:52 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:51:56 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:51:59 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:52:03 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:52:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:52:06 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18997398, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567870, 'download_latency': 0.6374711990356445, 'depth': 0} 2025-03-10 00:52:06 [reviews] INFO: Scraped item: {'review': 'Packaging charges 45 is too much . quantity 250 gm is less of value rupees 199 . no needed varieties of Packaging . Quality and quantity is more important.
but test is good ๐Ÿ‘ ', 'review_id': 284609234, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18997398} 2025-03-10 00:52:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18997398&page=1> {'review': 'Packaging charges 45 is too much . quantity 250 gm is less of value rupees 199 . no needed varieties of Packaging . Quality and quantity is more important.
but test is good ๐Ÿ‘ ', 'review_id': 284609234, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18997398} 2025-03-10 00:52:06 [reviews] INFO: Scraped item: {'review': "I've had better biryani.", 'review_id': 284430152, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18997398} 2025-03-10 00:52:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18997398&page=1> {'review': "I've had better biryani.", 'review_id': 284430152, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18997398} 2025-03-10 00:52:06 [reviews] INFO: Scraped item: {'review': 'I guess this is the most unsatisfactory order I got from BBK. Biryani was too salty with almost nill spices.', 'review_id': 283870678, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18997398} 2025-03-10 00:52:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18997398&page=1> {'review': 'I guess this is the most unsatisfactory order I got from BBK. Biryani was too salty with almost nill spices.', 'review_id': 283870678, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18997398} 2025-03-10 00:52:06 [reviews] INFO: Scraped item: {'review': 'amazing biryani. specially chiken Haidrabadi biryani. ', 'review_id': 283327058, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18997398} 2025-03-10 00:52:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18997398&page=1> {'review': 'amazing biryani. specially chiken Haidrabadi biryani. ', 'review_id': 283327058, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18997398} 2025-03-10 00:52:06 [reviews] INFO: Scraped item: {'review': "Chicken was raw from inside. Wasn't tasty at all.", 'review_id': 283326676, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18997398} 2025-03-10 00:52:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=18997398&page=1> {'review': "Chicken was raw from inside. Wasn't tasty at all.", 'review_id': 283326676, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 18997398} 2025-03-10 00:52:06 [scrapy.extensions.logstats] INFO: Crawled 88 pages (at 2 pages/min), scraped 314 items (at 6 items/min) 2025-03-10 00:52:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:52:10 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Castle Mill', 'platform': 'zomato', 'res_id': 19022949, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567872, 'download_latency': 0.6522579193115234, 'depth': 0} 2025-03-10 00:52:10 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284605130, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Castle Mill', 'platform': 'zomato', 'res_id': 19022949} 2025-03-10 00:52:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19022949&page=1> {'review': '', 'review_id': 284605130, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Castle Mill', 'platform': 'zomato', 'res_id': 19022949} 2025-03-10 00:52:10 [reviews] INFO: Scraped item: {'review': "it's completely cold ", 'review_id': 284587721, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Castle Mill', 'platform': 'zomato', 'res_id': 19022949} 2025-03-10 00:52:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19022949&page=1> {'review': "it's completely cold ", 'review_id': 284587721, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Castle Mill', 'platform': 'zomato', 'res_id': 19022949} 2025-03-10 00:52:10 [reviews] INFO: Scraped item: {'review': 'cold and soggy rolls', 'review_id': 283518198, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Castle Mill', 'platform': 'zomato', 'res_id': 19022949} 2025-03-10 00:52:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19022949&page=1> {'review': 'cold and soggy rolls', 'review_id': 283518198, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Castle Mill', 'platform': 'zomato', 'res_id': 19022949} 2025-03-10 00:52:10 [reviews] INFO: Stopping for res_id: 19022949 as reviews are older than 7 days. 2025-03-10 00:52:13 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:52:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:52:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:52:24 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:52:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:52:29 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567892, 'download_latency': 0.703577995300293, 'depth': 0} 2025-03-10 00:52:29 [reviews] INFO: Scraped item: {'review': 'Too spicy', 'review_id': 284598297, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625} 2025-03-10 00:52:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19104625&page=1> {'review': 'Too spicy', 'review_id': 284598297, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625} 2025-03-10 00:52:29 [reviews] INFO: Scraped item: {'review': 'Cold', 'review_id': 284594744, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625} 2025-03-10 00:52:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19104625&page=1> {'review': 'Cold', 'review_id': 284594744, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625} 2025-03-10 00:52:29 [reviews] INFO: Scraped item: {'review': 'Biryani was good 1 star
raita was good 1 star
Salan was good 1 star
Complementary Salad Onion Rings 1 star
overall customer support as they call you and adjust your food as per your requirements and sometimes provide you complementary items like salad. And my delivery partner Kalu deliver my order in no time. One shoutout for him', 'review_id': 284456822, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625} 2025-03-10 00:52:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19104625&page=1> {'review': 'Biryani was good 1 star
raita was good 1 star
Salan was good 1 star
Complementary Salad Onion Rings 1 star
overall customer support as they call you and adjust your food as per your requirements and sometimes provide you complementary items like salad. And my delivery partner Kalu deliver my order in no time. One shoutout for him', 'review_id': 284456822, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625} 2025-03-10 00:52:29 [reviews] INFO: Scraped item: {'review': 'Tasty food', 'review_id': 284434547, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625} 2025-03-10 00:52:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19104625&page=1> {'review': 'Tasty food', 'review_id': 284434547, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625} 2025-03-10 00:52:29 [reviews] INFO: Scraped item: {'review': 'Best Chicken 65 Biryani than any other restaurant. ', 'review_id': 283918764, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625} 2025-03-10 00:52:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19104625&page=1> {'review': 'Best Chicken 65 Biryani than any other restaurant. ', 'review_id': 283918764, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 19104625} 2025-03-10 00:52:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:52:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:52:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:52:43 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:52:47 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:52:51 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:52:55 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:52:58 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:53:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:53:02 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567923, 'download_latency': 0.661890983581543, 'depth': 0} 2025-03-10 00:53:02 [reviews] INFO: Scraped item: {'review': 'After waiting in line for 40 mins the staff doesnโ€™t even let you eat in peace. There is a rush to push you out! Donโ€™t come if you want a peaceful catchup with your friend', 'review_id': 284347176, 'rating': '2', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928} 2025-03-10 00:53:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19119928&page=1> {'review': 'After waiting in line for 40 mins the staff doesnโ€™t even let you eat in peace. There is a rush to push you out! Donโ€™t come if you want a peaceful catchup with your friend', 'review_id': 284347176, 'rating': '2', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928} 2025-03-10 00:53:02 [reviews] INFO: Scraped item: {'review': 'No paneer and insufficient delay', 'review_id': 284334014, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928} 2025-03-10 00:53:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19119928&page=1> {'review': 'No paneer and insufficient delay', 'review_id': 284334014, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928} 2025-03-10 00:53:02 [reviews] INFO: Scraped item: {'review': 'Considering the prices on offer, should be doing better quality check as the entire avocado used in the sandwich was clearly not fresh. I hold them to a much higher standard. Hopefully u have better quality checks moving ahead.', 'review_id': 284272794, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928} 2025-03-10 00:53:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19119928&page=1> {'review': 'Considering the prices on offer, should be doing better quality check as the entire avocado used in the sandwich was clearly not fresh. I hold them to a much higher standard. Hopefully u have better quality checks moving ahead.', 'review_id': 284272794, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928} 2025-03-10 00:53:02 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284272219, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928} 2025-03-10 00:53:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19119928&page=1> {'review': '', 'review_id': 284272219, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928} 2025-03-10 00:53:02 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283917412, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928} 2025-03-10 00:53:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19119928&page=1> {'review': '', 'review_id': 283917412, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 24, 'brand_name': 'Boojee Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19119928} 2025-03-10 00:53:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:53:06 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 45, 'brand_name': 'The Shaka Cafe', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19123522, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567926, 'download_latency': 0.6679263114929199, 'depth': 0} 2025-03-10 00:53:06 [reviews] INFO: Scraped item: {'review': "perfect place for anyday, my go to place. will recommend everyone to try sushi, you'll be fan of this place", 'review_id': 284303554, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 45, 'brand_name': 'The Shaka Cafe', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19123522} 2025-03-10 00:53:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19123522&page=1> {'review': "perfect place for anyday, my go to place. will recommend everyone to try sushi, you'll be fan of this place", 'review_id': 284303554, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 45, 'brand_name': 'The Shaka Cafe', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19123522} 2025-03-10 00:53:06 [reviews] INFO: Stopping for res_id: 19123522 as reviews are older than 7 days. 2025-03-10 00:53:06 [scrapy.extensions.logstats] INFO: Crawled 92 pages (at 4 pages/min), scraped 328 items (at 14 items/min) 2025-03-10 00:53:08 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:53:13 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:53:16 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:53:20 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:53:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:53:25 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 38, 'brand_name': 'Lavonne', 'city': 'Bangalore', 'sub_zone': 'St. Marks Road', 'platform': 'zomato', 'res_id': 19142873, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567945, 'download_latency': 0.6513962745666504, 'depth': 0} 2025-03-10 00:53:25 [reviews] INFO: Stopping for res_id: 19142873 as reviews are older than 7 days. 2025-03-10 00:53:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:53:27 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567949, 'download_latency': 0.6465489864349365, 'depth': 0} 2025-03-10 00:53:27 [reviews] INFO: Scraped item: {'review': 'Toooooo Bad. No taste. Only dry rice. I m really shocked.', 'review_id': 284593210, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838} 2025-03-10 00:53:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19168838&page=1> {'review': 'Toooooo Bad. No taste. Only dry rice. I m really shocked.', 'review_id': 284593210, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838} 2025-03-10 00:53:27 [reviews] INFO: Scraped item: {'review': 'Biriyani was sent with only rice. No vegetables', 'review_id': 284562592, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838} 2025-03-10 00:53:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19168838&page=1> {'review': 'Biriyani was sent with only rice. No vegetables', 'review_id': 284562592, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838} 2025-03-10 00:53:27 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284174070, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838} 2025-03-10 00:53:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19168838&page=1> {'review': '', 'review_id': 284174070, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838} 2025-03-10 00:53:27 [reviews] INFO: Scraped item: {'review': 'It was more like a chicken masala gravy rather than Haleem, No fried onions on top also (bhai haleem ke naam pe kya de rahe ho aap)', 'review_id': 283739420, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838} 2025-03-10 00:53:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19168838&page=1> {'review': 'It was more like a chicken masala gravy rather than Haleem, No fried onions on top also (bhai haleem ke naam pe kya de rahe ho aap)', 'review_id': 283739420, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838} 2025-03-10 00:53:27 [reviews] INFO: Scraped item: {'review': 'What fragrance... delicious..super handi packaging.... excellent ', 'review_id': 283525711, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838} 2025-03-10 00:53:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19168838&page=1> {'review': 'What fragrance... delicious..super handi packaging.... excellent ', 'review_id': 283525711, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19168838} 2025-03-10 00:53:31 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:53:34 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:53:39 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:53:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:53:45 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:53:50 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:53:53 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:54:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:54:01 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 19194488, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567982, 'download_latency': 1.6118483543395996, 'depth': 0} 2025-03-10 00:54:01 [reviews] INFO: Scraped item: {'review': "very dry and expensive not worth no taste it's tasteless ", 'review_id': 284522327, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 19194488} 2025-03-10 00:54:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19194488&page=1> {'review': "very dry and expensive not worth no taste it's tasteless ", 'review_id': 284522327, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 19194488} 2025-03-10 00:54:01 [reviews] INFO: Scraped item: {'review': 'Quantity is less. Served with accompaniments such as mint chutney and onion salad', 'review_id': 284340417, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 19194488} 2025-03-10 00:54:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19194488&page=1> {'review': 'Quantity is less. Served with accompaniments such as mint chutney and onion salad', 'review_id': 284340417, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 19194488} 2025-03-10 00:54:01 [reviews] INFO: Scraped item: {'review': 'Rice was very tasty. somehow the chicken was ok. but all in all it was good.', 'review_id': 284299992, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 19194488} 2025-03-10 00:54:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19194488&page=1> {'review': 'Rice was very tasty. somehow the chicken was ok. but all in all it was good.', 'review_id': 284299992, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 19194488} 2025-03-10 00:54:01 [reviews] INFO: Scraped item: {'review': 'The packaging was excellent, a really good experience. When it is actually served in an hundi.
The kuthal biryani was so tasty and uff! The gajar halwa, mind-blowing so yummy so yummy. This is to the chef. The gajar was perfectly cooked perfectly sweeten. Amazing loved it', 'review_id': 284168398, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 19194488} 2025-03-10 00:54:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19194488&page=1> {'review': 'The packaging was excellent, a really good experience. When it is actually served in an hundi.
The kuthal biryani was so tasty and uff! The gajar halwa, mind-blowing so yummy so yummy. This is to the chef. The gajar was perfectly cooked perfectly sweeten. Amazing loved it', 'review_id': 284168398, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 19194488} 2025-03-10 00:54:01 [reviews] INFO: Scraped item: {'review': 'no teste at all..Try House of Biryan....for much better biryani ', 'review_id': 284143826, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 19194488} 2025-03-10 00:54:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19194488&page=1> {'review': 'no teste at all..Try House of Biryan....for much better biryani ', 'review_id': 284143826, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 19194488} 2025-03-10 00:54:04 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:54:06 [scrapy.extensions.logstats] INFO: Crawled 95 pages (at 3 pages/min), scraped 338 items (at 10 items/min) 2025-03-10 00:54:08 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:54:11 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:54:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:54:16 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567997, 'download_latency': 0.7672410011291504, 'depth': 0} 2025-03-10 00:54:16 [reviews] INFO: Scraped item: {'review': 'Biryani was dry', 'review_id': 284565251, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026} 2025-03-10 00:54:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19195026&page=1> {'review': 'Biryani was dry', 'review_id': 284565251, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026} 2025-03-10 00:54:16 [reviews] INFO: Scraped item: {'review': 'hopeless, deliverd 1 handi instead if 2 ordered. now not giving refund nor replacement', 'review_id': 284356011, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026} 2025-03-10 00:54:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19195026&page=1> {'review': 'hopeless, deliverd 1 handi instead if 2 ordered. now not giving refund nor replacement', 'review_id': 284356011, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026} 2025-03-10 00:54:16 [reviews] INFO: Scraped item: {'review': 'Quantity is quite less.', 'review_id': 284144775, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026} 2025-03-10 00:54:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19195026&page=1> {'review': 'Quantity is quite less.', 'review_id': 284144775, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026} 2025-03-10 00:54:16 [reviews] INFO: Scraped item: {'review': 'Quantity was less with only one piece๐Ÿ‘Ž๐Ÿป', 'review_id': 283851435, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026} 2025-03-10 00:54:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19195026&page=1> {'review': 'Quantity was less with only one piece๐Ÿ‘Ž๐Ÿป', 'review_id': 283851435, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026} 2025-03-10 00:54:16 [reviews] INFO: Scraped item: {'review': 'food is delivered in damaged condition ', 'review_id': 283757175, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026} 2025-03-10 00:54:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19195026&page=1> {'review': 'food is delivered in damaged condition ', 'review_id': 283757175, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Ghodbunder Road', 'platform': 'zomato', 'res_id': 19195026} 2025-03-10 00:54:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:54:16 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741567979, 'download_latency': 19.814383268356323, 'depth': 0} 2025-03-10 00:54:16 [reviews] INFO: Scraped item: {'review': 'loss of instruction seen', 'review_id': 284591695, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777} 2025-03-10 00:54:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19180777&page=1> {'review': 'loss of instruction seen', 'review_id': 284591695, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777} 2025-03-10 00:54:16 [reviews] INFO: Scraped item: {'review': 'Delivered pulaav', 'review_id': 284347210, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777} 2025-03-10 00:54:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19180777&page=1> {'review': 'Delivered pulaav', 'review_id': 284347210, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777} 2025-03-10 00:54:16 [reviews] INFO: Scraped item: {'review': 'cockroach in food ', 'review_id': 284334830, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777} 2025-03-10 00:54:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19180777&page=1> {'review': 'cockroach in food ', 'review_id': 284334830, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777} 2025-03-10 00:54:16 [reviews] INFO: Scraped item: {'review': 'Delicious Biryanai', 'review_id': 284237235, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777} 2025-03-10 00:54:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19180777&page=1> {'review': 'Delicious Biryanai', 'review_id': 284237235, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777} 2025-03-10 00:54:16 [reviews] INFO: Scraped item: {'review': "Only reason I'm giving 3 star is because of the quantity of the food! Its has gone down wayyy below from what it used to be but the price has remained same!", 'review_id': 284162186, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777} 2025-03-10 00:54:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19180777&page=1> {'review': "Only reason I'm giving 3 star is because of the quantity of the food! Its has gone down wayyy below from what it used to be but the price has remained same!", 'review_id': 284162186, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 15, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mahakali', 'platform': 'zomato', 'res_id': 19180777} 2025-03-10 00:54:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:54:19 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'K Star Mall', 'platform': 'zomato', 'res_id': 19205663, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568000, 'download_latency': 0.7973480224609375, 'depth': 0} 2025-03-10 00:54:19 [reviews] INFO: Stopping for res_id: 19205663 as reviews are older than 7 days. 2025-03-10 00:54:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:54:23 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 32, 'brand_name': 'Third Wave Coffee', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19207047, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568005, 'download_latency': 0.9532761573791504, 'depth': 0} 2025-03-10 00:54:23 [reviews] INFO: Stopping for res_id: 19207047 as reviews are older than 7 days. 2025-03-10 00:54:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:54:28 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 12, 'brand_name': 'Kuai Kitchen', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19247726, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568008, 'download_latency': 0.833977222442627, 'depth': 0} 2025-03-10 00:54:28 [reviews] INFO: Scraped item: {'review': 'Small Quantities - what has been advertised versus what is served', 'review_id': 284546346, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 12, 'brand_name': 'Kuai Kitchen', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19247726} 2025-03-10 00:54:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19247726&page=1> {'review': 'Small Quantities - what has been advertised versus what is served', 'review_id': 284546346, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 12, 'brand_name': 'Kuai Kitchen', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19247726} 2025-03-10 00:54:28 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284495133, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 12, 'brand_name': 'Kuai Kitchen', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19247726} 2025-03-10 00:54:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19247726&page=1> {'review': '', 'review_id': 284495133, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 12, 'brand_name': 'Kuai Kitchen', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19247726} 2025-03-10 00:54:28 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283313833, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 12, 'brand_name': 'Kuai Kitchen', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19247726} 2025-03-10 00:54:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19247726&page=1> {'review': '', 'review_id': 283313833, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 12, 'brand_name': 'Kuai Kitchen', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19247726} 2025-03-10 00:54:28 [reviews] INFO: Scraped item: {'review': 'the food of kuai was really good. now not very good. ', 'review_id': 283152658, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 12, 'brand_name': 'Kuai Kitchen', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19247726} 2025-03-10 00:54:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19247726&page=1> {'review': 'the food of kuai was really good. now not very good. ', 'review_id': 283152658, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 12, 'brand_name': 'Kuai Kitchen', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19247726} 2025-03-10 00:54:28 [reviews] INFO: Stopping for res_id: 19247726 as reviews are older than 7 days. 2025-03-10 00:54:31 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:54:34 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:54:37 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:54:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:54:45 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:54:49 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:54:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:54:57 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 52, 'brand_name': 'The Flaming Bowl', 'city': 'Kolkata', 'sub_zone': 'Bhawanipur', 'platform': 'zomato', 'res_id': 19270163, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568042, 'download_latency': 0.7847895622253418, 'depth': 0} 2025-03-10 00:54:57 [reviews] INFO: Scraped item: {'review': "The sushi smells like its old and pre kept not even in a freezer. Tastes like shit. Please don't order the sushi atleast.", 'review_id': 283111007, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 52, 'brand_name': 'The Flaming Bowl', 'city': 'Kolkata', 'sub_zone': 'Bhawanipur', 'platform': 'zomato', 'res_id': 19270163} 2025-03-10 00:54:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19270163&page=1> {'review': "The sushi smells like its old and pre kept not even in a freezer. Tastes like shit. Please don't order the sushi atleast.", 'review_id': 283111007, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 52, 'brand_name': 'The Flaming Bowl', 'city': 'Kolkata', 'sub_zone': 'Bhawanipur', 'platform': 'zomato', 'res_id': 19270163} 2025-03-10 00:54:57 [reviews] INFO: Scraped item: {'review': "Best restaurant in the city! I've been frequenting this place almost every month โ€“ it's that good! The food, the menu, the variety, the ambience, the staff - everything deserves more than five stars!", 'review_id': 282586503, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-04', 'competitor_id': 52, 'brand_name': 'The Flaming Bowl', 'city': 'Kolkata', 'sub_zone': 'Bhawanipur', 'platform': 'zomato', 'res_id': 19270163} 2025-03-10 00:54:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19270163&page=1> {'review': "Best restaurant in the city! I've been frequenting this place almost every month โ€“ it's that good! The food, the menu, the variety, the ambience, the staff - everything deserves more than five stars!", 'review_id': 282586503, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-04', 'competitor_id': 52, 'brand_name': 'The Flaming Bowl', 'city': 'Kolkata', 'sub_zone': 'Bhawanipur', 'platform': 'zomato', 'res_id': 19270163} 2025-03-10 00:54:57 [reviews] INFO: Stopping for res_id: 19270163 as reviews are older than 7 days. 2025-03-10 00:54:59 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:55:03 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:55:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-10 00:55:06 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-10 00:55:06 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:55:06 [scrapy.extensions.logstats] INFO: Crawled 101 pages (at 6 pages/min), scraped 354 items (at 16 items/min) 2025-03-10 00:55:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:55:10 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 19295012, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568056, 'download_latency': 0.7669734954833984, 'depth': 0} 2025-03-10 00:55:10 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284608665, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 19295012} 2025-03-10 00:55:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19295012&page=1> {'review': '', 'review_id': 284608665, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 19295012} 2025-03-10 00:55:10 [reviews] INFO: Scraped item: {'review': 'food was good nd tasty ', 'review_id': 284383295, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 19295012} 2025-03-10 00:55:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19295012&page=1> {'review': 'food was good nd tasty ', 'review_id': 284383295, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 19295012} 2025-03-10 00:55:10 [reviews] INFO: Scraped item: {'review': 'The food they serve is very exquisite and the presentation is neat and clean. The food arrived hot and freshly cooked . Nice', 'review_id': 284347167, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 19295012} 2025-03-10 00:55:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19295012&page=1> {'review': 'The food they serve is very exquisite and the presentation is neat and clean. The food arrived hot and freshly cooked . Nice', 'review_id': 284347167, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 19295012} 2025-03-10 00:55:10 [reviews] INFO: Scraped item: {'review': 'Very fresh very good', 'review_id': 283985242, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 19295012} 2025-03-10 00:55:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19295012&page=1> {'review': 'Very fresh very good', 'review_id': 283985242, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 19295012} 2025-03-10 00:55:10 [reviews] INFO: Scraped item: {'review': 'The taste is good but only 2-3 chaap chopped pieces were added for the whole box. You can either add more chaap pieces or add an option to pay for extra pieces. The quantity provided was in no way justified.', 'review_id': 283378663, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 19295012} 2025-03-10 00:55:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19295012&page=1> {'review': 'The taste is good but only 2-3 chaap chopped pieces were added for the whole box. You can either add more chaap pieces or add an option to pay for extra pieces. The quantity provided was in no way justified.', 'review_id': 283378663, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'New Delhi', 'sub_zone': 'Rajouri Garden', 'platform': 'zomato', 'res_id': 19295012} 2025-03-10 00:55:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:55:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:55:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): User timeout caused connection failure: Getting https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19257266&page=1 took longer than 30.0 seconds.. 2025-03-10 00:55:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:55:23 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 19338435, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568064, 'download_latency': 0.8279106616973877, 'depth': 0} 2025-03-10 00:55:23 [reviews] INFO: Scraped item: {'review': 'Osm ๐Ÿ‘Œ Biryani,
too good', 'review_id': 283077860, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 19338435} 2025-03-10 00:55:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19338435&page=1> {'review': 'Osm ๐Ÿ‘Œ Biryani,
too good', 'review_id': 283077860, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 19338435} 2025-03-10 00:55:23 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283042008, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 19338435} 2025-03-10 00:55:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19338435&page=1> {'review': '', 'review_id': 283042008, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Sanpada', 'platform': 'zomato', 'res_id': 19338435} 2025-03-10 00:55:23 [reviews] INFO: Stopping for res_id: 19338435 as reviews are older than 7 days. 2025-03-10 00:55:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:55:28 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 19347326, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568068, 'download_latency': 0.7673885822296143, 'depth': 0} 2025-03-10 00:55:28 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284263248, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 19347326} 2025-03-10 00:55:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19347326&page=1> {'review': '', 'review_id': 284263248, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 19347326} 2025-03-10 00:55:28 [reviews] INFO: Scraped item: {'review': 'I have requested to add message on delivery', 'review_id': 283935317, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 19347326} 2025-03-10 00:55:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19347326&page=1> {'review': 'I have requested to add message on delivery', 'review_id': 283935317, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Byculla', 'platform': 'zomato', 'res_id': 19347326} 2025-03-10 00:55:28 [reviews] INFO: Stopping for res_id: 19347326 as reviews are older than 7 days. 2025-03-10 00:55:31 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:55:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:55:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:55:43 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:55:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:55:48 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568086, 'download_latency': 0.7687258720397949, 'depth': 0} 2025-03-10 00:55:48 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284456283, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793} 2025-03-10 00:55:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19470793&page=1> {'review': '', 'review_id': 284456283, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793} 2025-03-10 00:55:48 [reviews] INFO: Scraped item: {'review': 'Rich, creamy, and packed with flavor, Persia Darbarโ€™s Butter Chicken Meal Box is a must-try for butter chicken lovers', 'review_id': 284357325, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793} 2025-03-10 00:55:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19470793&page=1> {'review': 'Rich, creamy, and packed with flavor, Persia Darbarโ€™s Butter Chicken Meal Box is a must-try for butter chicken lovers', 'review_id': 284357325, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793} 2025-03-10 00:55:48 [reviews] INFO: Scraped item: {'review': 'Meal Box is a complete and filling meal for one, with Butter Chicken, a soft Kulcha, and Gulab Jamun. Taste is top notch creamy & flavour full. Packing is also good.', 'review_id': 284350348, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793} 2025-03-10 00:55:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19470793&page=1> {'review': 'Meal Box is a complete and filling meal for one, with Butter Chicken, a soft Kulcha, and Gulab Jamun. Taste is top notch creamy & flavour full. Packing is also good.', 'review_id': 284350348, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793} 2025-03-10 00:55:48 [reviews] INFO: Scraped item: {'review': 'it is not briyani the gravy is not come in briyani ', 'review_id': 284254469, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793} 2025-03-10 00:55:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19470793&page=1> {'review': 'it is not briyani the gravy is not come in briyani ', 'review_id': 284254469, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793} 2025-03-10 00:55:48 [reviews] INFO: Scraped item: {'review': "I recently tried the Caramel Custard and Fried Noodles from Persia Darbar, and I was blown away by the flavors! The caramel custard was creamy, rich, and perfectly balanced, with a caramel sauce that added just the right amount of sweetness. The fried noodles were crispy, savory, and utterly addictive, with a delightful texture that left me wanting more. Both dishes were expertly prepared and presented, and I'd highly recommend them to anyone looking for a delicious treat. Fantastic job, Persia Darbar.", 'review_id': 284221678, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793} 2025-03-10 00:55:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19470793&page=1> {'review': "I recently tried the Caramel Custard and Fried Noodles from Persia Darbar, and I was blown away by the flavors! The caramel custard was creamy, rich, and perfectly balanced, with a caramel sauce that added just the right amount of sweetness. The fried noodles were crispy, savory, and utterly addictive, with a delightful texture that left me wanting more. Both dishes were expertly prepared and presented, and I'd highly recommend them to anyone looking for a delicious treat. Fantastic job, Persia Darbar.", 'review_id': 284221678, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 19470793} 2025-03-10 00:55:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:55:52 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568089, 'download_latency': 1.1975231170654297, 'depth': 0} 2025-03-10 00:55:52 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284621621, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939} 2025-03-10 00:55:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19494939&page=1> {'review': '', 'review_id': 284621621, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939} 2025-03-10 00:55:52 [reviews] INFO: Scraped item: {'review': 'chicken is not cooked properly!! ', 'review_id': 284262569, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939} 2025-03-10 00:55:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19494939&page=1> {'review': 'chicken is not cooked properly!! ', 'review_id': 284262569, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939} 2025-03-10 00:55:52 [reviews] INFO: Scraped item: {'review': 'Received cold and rice quality is getting poor day by day.', 'review_id': 283772362, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939} 2025-03-10 00:55:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19494939&page=1> {'review': 'Received cold and rice quality is getting poor day by day.', 'review_id': 283772362, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939} 2025-03-10 00:55:52 [reviews] INFO: Scraped item: {'review': "The first thing was that the order was 27 minutes delayed and after all this they gave me this unhygienic cutlery here I'm attaching the photos ", 'review_id': 283760372, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939} 2025-03-10 00:55:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19494939&page=1> {'review': "The first thing was that the order was 27 minutes delayed and after all this they gave me this unhygienic cutlery here I'm attaching the photos ", 'review_id': 283760372, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939} 2025-03-10 00:55:52 [reviews] INFO: Scraped item: {'review': 'biryani taste was very different and does not taste like the usual days. this used to be my favourite biryani but the quality of the biryani has decreased a lot. not recommended this outlet', 'review_id': 283748208, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939} 2025-03-10 00:55:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19494939&page=1> {'review': 'biryani taste was very different and does not taste like the usual days. this used to be my favourite biryani but the quality of the biryani has decreased a lot. not recommended this outlet', 'review_id': 283748208, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Sohna Road', 'platform': 'zomato', 'res_id': 19494939} 2025-03-10 00:55:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:55:56 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568098, 'download_latency': 0.7997286319732666, 'depth': 0} 2025-03-10 00:55:56 [reviews] INFO: Scraped item: {'review': 'bakwaas taste ', 'review_id': 284597755, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084} 2025-03-10 00:55:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19497084&page=1> {'review': 'bakwaas taste ', 'review_id': 284597755, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084} 2025-03-10 00:55:56 [reviews] INFO: Scraped item: {'review': 'Biryani was not cooked properly, no fresh vegetables, all vegtables were not fresh, not good taste at all as rice was also not cooked properly', 'review_id': 284563967, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084} 2025-03-10 00:55:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19497084&page=1> {'review': 'Biryani was not cooked properly, no fresh vegetables, all vegtables were not fresh, not good taste at all as rice was also not cooked properly', 'review_id': 284563967, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084} 2025-03-10 00:55:56 [reviews] INFO: Scraped item: {'review': 'for 249 rs the portion of chicken 65 is extremely less.. literally only 6 small pieces of chicken were included', 'review_id': 284176932, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084} 2025-03-10 00:55:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19497084&page=1> {'review': 'for 249 rs the portion of chicken 65 is extremely less.. literally only 6 small pieces of chicken were included', 'review_id': 284176932, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084} 2025-03-10 00:55:56 [reviews] INFO: Scraped item: {'review': 'Food is not cooked properly', 'review_id': 283937229, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084} 2025-03-10 00:55:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19497084&page=1> {'review': 'Food is not cooked properly', 'review_id': 283937229, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084} 2025-03-10 00:55:56 [reviews] INFO: Scraped item: {'review': 'It was taste less, it seems like they have just sent boiled rice with chicken pieces', 'review_id': 283816713, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084} 2025-03-10 00:55:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19497084&page=1> {'review': 'It was taste less, it seems like they have just sent boiled rice with chicken pieces', 'review_id': 283816713, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 21, 'brand_name': 'Biryani Blues', 'city': 'Noida', 'sub_zone': 'Sector 72', 'platform': 'zomato', 'res_id': 19497084} 2025-03-10 00:55:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:56:01 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:56:05 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:56:06 [scrapy.extensions.logstats] INFO: Crawled 107 pages (at 6 pages/min), scraped 378 items (at 24 items/min) 2025-03-10 00:56:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:56:10 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568111, 'download_latency': 1.7566509246826172, 'depth': 0} 2025-03-10 00:56:10 [reviews] INFO: Scraped item: {'review': "asked some extra Schezwan sauce,haven't provided ", 'review_id': 284145068, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567} 2025-03-10 00:56:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19512567&page=1> {'review': "asked some extra Schezwan sauce,haven't provided ", 'review_id': 284145068, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567} 2025-03-10 00:56:10 [reviews] INFO: Scraped item: {'review': 'added nonveg momo in veg momo packets', 'review_id': 284040295, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567} 2025-03-10 00:56:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19512567&page=1> {'review': 'added nonveg momo in veg momo packets', 'review_id': 284040295, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567} 2025-03-10 00:56:10 [reviews] INFO: Scraped item: {'review': 'Worst ever experience, food was cold as ice perhaps i choose for noodles & rice i only received noodles', 'review_id': 283533826, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567} 2025-03-10 00:56:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19512567&page=1> {'review': 'Worst ever experience, food was cold as ice perhaps i choose for noodles & rice i only received noodles', 'review_id': 283533826, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567} 2025-03-10 00:56:10 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283390474, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567} 2025-03-10 00:56:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19512567&page=1> {'review': '', 'review_id': 283390474, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567} 2025-03-10 00:56:10 [reviews] INFO: Scraped item: {'review': 'Schezwan noodles is just tossed in Schezwan sauce. No salt....very bland', 'review_id': 282735915, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567} 2025-03-10 00:56:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19512567&page=1> {'review': 'Schezwan noodles is just tossed in Schezwan sauce. No salt....very bland', 'review_id': 282735915, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 19512567} 2025-03-10 00:56:12 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:56:15 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:56:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:56:20 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568122, 'retry_times': 1, 'download_latency': 0.7899951934814453, 'depth': 0} 2025-03-10 00:56:20 [reviews] INFO: Scraped item: {'review': 'quality speaks ', 'review_id': 284541555, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266} 2025-03-10 00:56:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19257266&page=1> {'review': 'quality speaks ', 'review_id': 284541555, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266} 2025-03-10 00:56:20 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284054226, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266} 2025-03-10 00:56:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19257266&page=1> {'review': '', 'review_id': 284054226, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266} 2025-03-10 00:56:20 [reviews] INFO: Scraped item: {'review': 'The cake came totally broken into pieces very disappointed...despite charging extra money the delivery is very poor . Will never recommend anyone to order', 'review_id': 283677899, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266} 2025-03-10 00:56:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19257266&page=1> {'review': 'The cake came totally broken into pieces very disappointed...despite charging extra money the delivery is very poor . Will never recommend anyone to order', 'review_id': 283677899, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266} 2025-03-10 00:56:20 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283127323, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266} 2025-03-10 00:56:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19257266&page=1> {'review': '', 'review_id': 283127323, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266} 2025-03-10 00:56:20 [reviews] INFO: Scraped item: {'review': "The best cake slice I've ever eaten!", 'review_id': 282902701, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266} 2025-03-10 00:56:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19257266&page=1> {'review': "The best cake slice I've ever eaten!", 'review_id': 282902701, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Bangalore', 'sub_zone': 'Indiranagar', 'platform': 'zomato', 'res_id': 19257266} 2025-03-10 00:56:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:56:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:56:28 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Noida', 'sub_zone': 'Chaukhandi', 'platform': 'zomato', 'res_id': 19519013, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568128, 'download_latency': 0.7956979274749756, 'depth': 0} 2025-03-10 00:56:28 [reviews] INFO: Scraped item: {'review': 'No salt , qualty degraded. No ricr only gravy', 'review_id': 283258576, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Noida', 'sub_zone': 'Chaukhandi', 'platform': 'zomato', 'res_id': 19519013} 2025-03-10 00:56:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19519013&page=1> {'review': 'No salt , qualty degraded. No ricr only gravy', 'review_id': 283258576, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Noida', 'sub_zone': 'Chaukhandi', 'platform': 'zomato', 'res_id': 19519013} 2025-03-10 00:56:28 [reviews] INFO: Scraped item: {'review': 'Both veg and non veg biryani taste great', 'review_id': 282470418, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Noida', 'sub_zone': 'Chaukhandi', 'platform': 'zomato', 'res_id': 19519013} 2025-03-10 00:56:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19519013&page=1> {'review': 'Both veg and non veg biryani taste great', 'review_id': 282470418, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Noida', 'sub_zone': 'Chaukhandi', 'platform': 'zomato', 'res_id': 19519013} 2025-03-10 00:56:28 [reviews] INFO: Stopping for res_id: 19519013 as reviews are older than 7 days. 2025-03-10 00:56:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:56:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:56:41 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:56:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:56:46 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19530561, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568144, 'download_latency': 0.7746753692626953, 'depth': 0} 2025-03-10 00:56:46 [reviews] INFO: Scraped item: {'review': 'Very less quantity', 'review_id': 283559762, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19530561} 2025-03-10 00:56:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530561&page=1> {'review': 'Very less quantity', 'review_id': 283559762, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19530561} 2025-03-10 00:56:46 [reviews] INFO: Scraped item: {'review': 'bad taste. food was not fresh.', 'review_id': 283437686, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19530561} 2025-03-10 00:56:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530561&page=1> {'review': 'bad taste. food was not fresh.', 'review_id': 283437686, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19530561} 2025-03-10 00:56:46 [reviews] INFO: Scraped item: {'review': 'Lucknowi mutton biryani was good. Good flavors. 3 boneless mutton pieces and tender. Mutton Seekh Kabab had smell to it. Did not like cream/butter on it. Galouti was delicious.', 'review_id': 283131691, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19530561} 2025-03-10 00:56:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530561&page=1> {'review': 'Lucknowi mutton biryani was good. Good flavors. 3 boneless mutton pieces and tender. Mutton Seekh Kabab had smell to it. Did not like cream/butter on it. Galouti was delicious.', 'review_id': 283131691, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19530561} 2025-03-10 00:56:46 [reviews] INFO: Scraped item: {'review': 'Rice needs to be cooked more as it is hard for chewing.
chicken and spice is good.', 'review_id': 282584848, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19530561} 2025-03-10 00:56:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530561&page=1> {'review': 'Rice needs to be cooked more as it is hard for chewing.
chicken and spice is good.', 'review_id': 282584848, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19530561} 2025-03-10 00:56:46 [reviews] INFO: Stopping for res_id: 19530561 as reviews are older than 7 days. 2025-03-10 00:56:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:56:49 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568148, 'download_latency': 0.898209810256958, 'depth': 0} 2025-03-10 00:56:49 [reviews] INFO: Scraped item: {'review': 'Can be better. Not feel original existing test', 'review_id': 284543553, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900} 2025-03-10 00:56:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530900&page=1> {'review': 'Can be better. Not feel original existing test', 'review_id': 284543553, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900} 2025-03-10 00:56:49 [reviews] INFO: Scraped item: {'review': 'Good quality ', 'review_id': 284052368, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900} 2025-03-10 00:56:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530900&page=1> {'review': 'Good quality ', 'review_id': 284052368, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900} 2025-03-10 00:56:49 [reviews] INFO: Scraped item: {'review': 'ok Roll
small roll and stuffing contents for the high price ', 'review_id': 283910112, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900} 2025-03-10 00:56:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530900&page=1> {'review': 'ok Roll
small roll and stuffing contents for the high price ', 'review_id': 283910112, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900} 2025-03-10 00:56:49 [reviews] INFO: Scraped item: {'review': 'Not very cold enough ', 'review_id': 283796981, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900} 2025-03-10 00:56:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530900&page=1> {'review': 'Not very cold enough ', 'review_id': 283796981, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900} 2025-03-10 00:56:49 [reviews] INFO: Scraped item: {'review': 'no mutton in mutton biryani', 'review_id': 283742289, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900} 2025-03-10 00:56:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19530900&page=1> {'review': 'no mutton in mutton biryani', 'review_id': 283742289, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Dombivali East', 'platform': 'zomato', 'res_id': 19530900} 2025-03-10 00:56:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:56:53 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:56:56 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:57:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:57:04 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:57:06 [scrapy.extensions.logstats] INFO: Crawled 112 pages (at 5 pages/min), scraped 399 items (at 21 items/min) 2025-03-10 00:57:06 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:57:11 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:57:15 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:57:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:57:21 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:57:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:57:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:57:29 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:57:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:57:34 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568201, 'download_latency': 0.7738721370697021, 'depth': 0} 2025-03-10 00:57:34 [reviews] INFO: Scraped item: {'review': 'briyani was tasting like briyani ', 'review_id': 284492954, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041} 2025-03-10 00:57:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531041&page=1> {'review': 'briyani was tasting like briyani ', 'review_id': 284492954, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041} 2025-03-10 00:57:34 [reviews] INFO: Scraped item: {'review': "Delivery delayed by an hour very bad experience if you don't get delivery in time then food Quality have no sense", 'review_id': 284101941, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041} 2025-03-10 00:57:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531041&page=1> {'review': "Delivery delayed by an hour very bad experience if you don't get delivery in time then food Quality have no sense", 'review_id': 284101941, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041} 2025-03-10 00:57:34 [reviews] INFO: Scraped item: {'review': 'The biryani was gud but the rice quantity is less.', 'review_id': 283899520, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041} 2025-03-10 00:57:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531041&page=1> {'review': 'The biryani was gud but the rice quantity is less.', 'review_id': 283899520, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041} 2025-03-10 00:57:34 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283877827, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041} 2025-03-10 00:57:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531041&page=1> {'review': '', 'review_id': 283877827, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041} 2025-03-10 00:57:34 [reviews] INFO: Scraped item: {'review': 'Worst place', 'review_id': 283827525, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041} 2025-03-10 00:57:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531041&page=1> {'review': 'Worst place', 'review_id': 283827525, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Majiwada', 'platform': 'zomato', 'res_id': 19531041} 2025-03-10 00:57:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:57:37 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'City Mall', 'platform': 'zomato', 'res_id': 19531051, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568206, 'download_latency': 0.7625613212585449, 'depth': 0} 2025-03-10 00:57:37 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284625824, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'City Mall', 'platform': 'zomato', 'res_id': 19531051} 2025-03-10 00:57:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531051&page=1> {'review': '', 'review_id': 284625824, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'City Mall', 'platform': 'zomato', 'res_id': 19531051} 2025-03-10 00:57:37 [reviews] INFO: Scraped item: {'review': 'bad ๐Ÿ‘Ž', 'review_id': 283609264, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'City Mall', 'platform': 'zomato', 'res_id': 19531051} 2025-03-10 00:57:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531051&page=1> {'review': 'bad ๐Ÿ‘Ž', 'review_id': 283609264, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'City Mall', 'platform': 'zomato', 'res_id': 19531051} 2025-03-10 00:57:37 [reviews] INFO: Scraped item: {'review': 'should add one extra spoon atleast ', 'review_id': 283591937, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'City Mall', 'platform': 'zomato', 'res_id': 19531051} 2025-03-10 00:57:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19531051&page=1> {'review': 'should add one extra spoon atleast ', 'review_id': 283591937, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'City Mall', 'platform': 'zomato', 'res_id': 19531051} 2025-03-10 00:57:37 [reviews] INFO: Stopping for res_id: 19531051 as reviews are older than 7 days. 2025-03-10 00:57:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:57:41 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 43, 'brand_name': 'Wok Sushi Bao', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19542350, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568209, 'download_latency': 0.7554051876068115, 'depth': 0} 2025-03-10 00:57:41 [reviews] INFO: Scraped item: {'review': 'THE BEST bao ever!!', 'review_id': 283114044, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 43, 'brand_name': 'Wok Sushi Bao', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19542350} 2025-03-10 00:57:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19542350&page=1> {'review': 'THE BEST bao ever!!', 'review_id': 283114044, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 43, 'brand_name': 'Wok Sushi Bao', 'city': 'Ahmedabad ', 'sub_zone': 'Prahlad Nagar', 'platform': 'zomato', 'res_id': 19542350} 2025-03-10 00:57:41 [reviews] INFO: Stopping for res_id: 19542350 as reviews are older than 7 days. 2025-03-10 00:57:44 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:57:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:57:52 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:57:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:57:59 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:58:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:58:03 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:58:06 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:58:06 [scrapy.extensions.logstats] INFO: Crawled 115 pages (at 3 pages/min), scraped 408 items (at 9 items/min) 2025-03-10 00:58:08 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:58:12 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:58:15 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:58:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:58:23 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:58:26 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:58:29 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:58:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:58:34 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568262, 'download_latency': 1.6026039123535156, 'depth': 0} 2025-03-10 00:58:34 [reviews] INFO: Scraped item: {'review': 'The chicken in the Biryani was all smelling YUCKS and even the seekh kabab was half cooked and smelling bad.Stale chicken for sure.Never ordering again.', 'review_id': 284513083, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894} 2025-03-10 00:58:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19542894&page=1> {'review': 'The chicken in the Biryani was all smelling YUCKS and even the seekh kabab was half cooked and smelling bad.Stale chicken for sure.Never ordering again.', 'review_id': 284513083, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894} 2025-03-10 00:58:34 [reviews] INFO: Scraped item: {'review': "Kabab were totally uncooked and there were not sticking to stick . Today's biryani was average too . Only potato .", 'review_id': 284470532, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894} 2025-03-10 00:58:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19542894&page=1> {'review': "Kabab were totally uncooked and there were not sticking to stick . Today's biryani was average too . Only potato .", 'review_id': 284470532, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894} 2025-03-10 00:58:34 [reviews] INFO: Scraped item: {'review': 'Biryani was horrible. Chicken piece was roasted/cooked too much. not able to chew it. finally had to throw it.
it seems it was a stale cooked chicken.', 'review_id': 284205902, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894} 2025-03-10 00:58:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19542894&page=1> {'review': 'Biryani was horrible. Chicken piece was roasted/cooked too much. not able to chew it. finally had to throw it.
it seems it was a stale cooked chicken.', 'review_id': 284205902, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894} 2025-03-10 00:58:34 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283801703, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894} 2025-03-10 00:58:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19542894&page=1> {'review': '', 'review_id': 283801703, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894} 2025-03-10 00:58:34 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283703000, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894} 2025-03-10 00:58:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19542894&page=1> {'review': '', 'review_id': 283703000, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19542894} 2025-03-10 00:58:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:58:39 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:58:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:58:44 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:58:48 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:58:52 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:58:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:58:59 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:59:03 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:59:06 [scrapy.extensions.logstats] INFO: Crawled 116 pages (at 1 pages/min), scraped 413 items (at 5 items/min) 2025-03-10 00:59:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:59:11 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:59:15 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:59:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:59:19 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Matunga', 'platform': 'zomato', 'res_id': 19548251, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568303, 'download_latency': 0.7320616245269775, 'depth': 0} 2025-03-10 00:59:19 [reviews] INFO: Scraped item: {'review': 'Why so expensive? For this pizza? Its like some other pizza only... i called for it nd i thought it might be something exclusive... but thanks for delivering a normal pizza', 'review_id': 283464341, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Matunga', 'platform': 'zomato', 'res_id': 19548251} 2025-03-10 00:59:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19548251&page=1> {'review': 'Why so expensive? For this pizza? Its like some other pizza only... i called for it nd i thought it might be something exclusive... but thanks for delivering a normal pizza', 'review_id': 283464341, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Matunga', 'platform': 'zomato', 'res_id': 19548251} 2025-03-10 00:59:19 [reviews] INFO: Scraped item: {'review': "the pizza was cold and rock hard like stone. very dissatisfied with the level of service I'm receiving to the amount of money I'm paying", 'review_id': 283391995, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Matunga', 'platform': 'zomato', 'res_id': 19548251} 2025-03-10 00:59:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19548251&page=1> {'review': "the pizza was cold and rock hard like stone. very dissatisfied with the level of service I'm receiving to the amount of money I'm paying", 'review_id': 283391995, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Matunga', 'platform': 'zomato', 'res_id': 19548251} 2025-03-10 00:59:19 [reviews] INFO: Scraped item: {'review': 'The size of cake was less than a pastry', 'review_id': 283254461, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Matunga', 'platform': 'zomato', 'res_id': 19548251} 2025-03-10 00:59:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19548251&page=1> {'review': 'The size of cake was less than a pastry', 'review_id': 283254461, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Matunga', 'platform': 'zomato', 'res_id': 19548251} 2025-03-10 00:59:19 [reviews] INFO: Scraped item: {'review': '', 'review_id': 282821093, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Matunga', 'platform': 'zomato', 'res_id': 19548251} 2025-03-10 00:59:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19548251&page=1> {'review': '', 'review_id': 282821093, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Matunga', 'platform': 'zomato', 'res_id': 19548251} 2025-03-10 00:59:19 [reviews] INFO: Stopping for res_id: 19548251 as reviews are older than 7 days. 2025-03-10 00:59:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:59:24 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19548739, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568306, 'download_latency': 0.8210921287536621, 'depth': 0} 2025-03-10 00:59:24 [reviews] INFO: Scraped item: {'review': 'Very Good Taste except Veg Charcoal Briyani was not great at all.', 'review_id': 282920337, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19548739} 2025-03-10 00:59:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19548739&page=1> {'review': 'Very Good Taste except Veg Charcoal Briyani was not great at all.', 'review_id': 282920337, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19548739} 2025-03-10 00:59:24 [reviews] INFO: Stopping for res_id: 19548739 as reviews are older than 7 days. 2025-03-10 00:59:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:59:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 00:59:32 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Juhu', 'platform': 'zomato', 'res_id': 19559682, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568315, 'download_latency': 0.6977856159210205, 'depth': 0} 2025-03-10 00:59:32 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284521559, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Juhu', 'platform': 'zomato', 'res_id': 19559682} 2025-03-10 00:59:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19559682&page=1> {'review': '', 'review_id': 284521559, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Juhu', 'platform': 'zomato', 'res_id': 19559682} 2025-03-10 00:59:32 [reviews] INFO: Scraped item: {'review': 'na', 'review_id': 283973123, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Juhu', 'platform': 'zomato', 'res_id': 19559682} 2025-03-10 00:59:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19559682&page=1> {'review': 'na', 'review_id': 283973123, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Juhu', 'platform': 'zomato', 'res_id': 19559682} 2025-03-10 00:59:32 [reviews] INFO: Scraped item: {'review': 'Yet again, Lunch was a delight! The biryani had the perfect blend of masalas flavourful and absolutely delicious. Kudos to Sunil Patel!', 'review_id': 282722258, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Juhu', 'platform': 'zomato', 'res_id': 19559682} 2025-03-10 00:59:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19559682&page=1> {'review': 'Yet again, Lunch was a delight! The biryani had the perfect blend of masalas flavourful and absolutely delicious. Kudos to Sunil Patel!', 'review_id': 282722258, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Juhu', 'platform': 'zomato', 'res_id': 19559682} 2025-03-10 00:59:32 [reviews] INFO: Stopping for res_id: 19559682 as reviews are older than 7 days. 2025-03-10 00:59:35 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:59:39 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:59:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:59:45 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:59:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:59:53 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 00:59:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:00:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:00:04 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:00:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-10 01:00:06 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-10 01:00:06 [scrapy.extensions.logstats] INFO: Crawled 119 pages (at 3 pages/min), scraped 421 items (at 8 items/min) 2025-03-10 01:00:08 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:00:12 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:00:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:00:15 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568356, 'download_latency': 0.750295877456665, 'depth': 0} 2025-03-10 01:00:15 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284614489, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464} 2025-03-10 01:00:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19562464&page=1> {'review': '', 'review_id': 284614489, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464} 2025-03-10 01:00:15 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283497985, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464} 2025-03-10 01:00:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19562464&page=1> {'review': '', 'review_id': 283497985, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464} 2025-03-10 01:00:15 [reviews] INFO: Scraped item: {'review': 'The food was stale, the kebab was undercooked and biryani had a weird smell.', 'review_id': 283356368, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464} 2025-03-10 01:00:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19562464&page=1> {'review': 'The food was stale, the kebab was undercooked and biryani had a weird smell.', 'review_id': 283356368, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464} 2025-03-10 01:00:15 [reviews] INFO: Scraped item: {'review': "the seekh inside the roll wasn't very fresh ", 'review_id': 283207652, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464} 2025-03-10 01:00:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19562464&page=1> {'review': "the seekh inside the roll wasn't very fresh ", 'review_id': 283207652, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464} 2025-03-10 01:00:15 [reviews] INFO: Scraped item: {'review': 'there was no gravy in it. it was very dry ', 'review_id': 283142978, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464} 2025-03-10 01:00:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19562464&page=1> {'review': 'there was no gravy in it. it was very dry ', 'review_id': 283142978, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Near Andheri East Station ', 'platform': 'zomato', 'res_id': 19562464} 2025-03-10 01:00:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:00:19 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 17, 'brand_name': 'Behrouz Biryani', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19566888, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568360, 'download_latency': 0.6992623805999756, 'depth': 0} 2025-03-10 01:00:19 [reviews] INFO: Stopping for res_id: 19566888 as reviews are older than 7 days. 2025-03-10 01:00:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:00:22 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568364, 'download_latency': 0.6949195861816406, 'depth': 0} 2025-03-10 01:00:22 [reviews] INFO: Scraped item: {'review': 'so tasty and flavourful โฃ๏ธ', 'review_id': 284427677, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166} 2025-03-10 01:00:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19570166&page=1> {'review': 'so tasty and flavourful โฃ๏ธ', 'review_id': 284427677, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166} 2025-03-10 01:00:22 [reviews] INFO: Scraped item: {'review': 'Burnt oil food given', 'review_id': 283791578, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166} 2025-03-10 01:00:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19570166&page=1> {'review': 'Burnt oil food given', 'review_id': 283791578, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166} 2025-03-10 01:00:22 [reviews] INFO: Scraped item: {'review': 'briyani is good bit I always Order extra gravy and pay for it but they never delever it.', 'review_id': 283678513, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166} 2025-03-10 01:00:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19570166&page=1> {'review': 'briyani is good bit I always Order extra gravy and pay for it but they never delever it.', 'review_id': 283678513, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166} 2025-03-10 01:00:22 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283217743, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166} 2025-03-10 01:00:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19570166&page=1> {'review': '', 'review_id': 283217743, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166} 2025-03-10 01:00:22 [reviews] INFO: Scraped item: {'review': 'very worst raste nowadays. earlier it was good ', 'review_id': 283213498, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166} 2025-03-10 01:00:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19570166&page=1> {'review': 'very worst raste nowadays. earlier it was good ', 'review_id': 283213498, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'Gurgaon', 'sub_zone': 'Ardee City', 'platform': 'zomato', 'res_id': 19570166} 2025-03-10 01:00:26 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:00:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:00:29 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 11, 'brand_name': 'Royal China', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19592218, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568372, 'download_latency': 0.6755282878875732, 'depth': 0} 2025-03-10 01:00:29 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284372449, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 11, 'brand_name': 'Royal China', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19592218} 2025-03-10 01:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19592218&page=1> {'review': '', 'review_id': 284372449, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 11, 'brand_name': 'Royal China', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19592218} 2025-03-10 01:00:29 [reviews] INFO: Scraped item: {'review': 'Taste average and RC brand over hyped as always. Filled with peanuts.', 'review_id': 283968118, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 11, 'brand_name': 'Royal China', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19592218} 2025-03-10 01:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19592218&page=1> {'review': 'Taste average and RC brand over hyped as always. Filled with peanuts.', 'review_id': 283968118, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 11, 'brand_name': 'Royal China', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19592218} 2025-03-10 01:00:29 [reviews] INFO: Scraped item: {'review': 'We have been visiting this place and we love the food. So we booked for our daughter\'s birthday lunch. The kids were having a great time. The food was superb as usual and the service, too. Then, so as not to disturb the other patrons inside, the girls just stepped out near the lift, just as we were done with our lunch and were settling the bill. I believe they were playing something and it was for barely 5- 7 minutes before I went to call them. The receptionist told them rudely that they should stop because "the girls are irritating". While we do appreciate that it could have been a distraction, the receptionist could have politely told them to go inside or even approached us adults. We would have ensured they immediately come inside. How can you talk to your patrons rudely and call them irritating on the face? The kids were hurt and the bday girl felt really bad. We have often been to this restaurant and there are kitty parties going on. Obviously sometimes they become louder than usual, but we have never complained. It\'s a group having their fun time. Here a bunch of kids were out for barely 5 to 7 minutes and you call them "irritating". A bad experience for a birthday. The receptionists definitely need training in etiquette in handling customers.', 'review_id': 283731182, 'rating': '2', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 11, 'brand_name': 'Royal China', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19592218} 2025-03-10 01:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19592218&page=1> {'review': 'We have been visiting this place and we love the food. So we booked for our daughter\'s birthday lunch. The kids were having a great time. The food was superb as usual and the service, too. Then, so as not to disturb the other patrons inside, the girls just stepped out near the lift, just as we were done with our lunch and were settling the bill. I believe they were playing something and it was for barely 5- 7 minutes before I went to call them. The receptionist told them rudely that they should stop because "the girls are irritating". While we do appreciate that it could have been a distraction, the receptionist could have politely told them to go inside or even approached us adults. We would have ensured they immediately come inside. How can you talk to your patrons rudely and call them irritating on the face? The kids were hurt and the bday girl felt really bad. We have often been to this restaurant and there are kitty parties going on. Obviously sometimes they become louder than usual, but we have never complained. It\'s a group having their fun time. Here a bunch of kids were out for barely 5 to 7 minutes and you call them "irritating". A bad experience for a birthday. The receptionists definitely need training in etiquette in handling customers.', 'review_id': 283731182, 'rating': '2', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 11, 'brand_name': 'Royal China', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 19592218} 2025-03-10 01:00:29 [reviews] INFO: Stopping for res_id: 19592218 as reviews are older than 7 days. 2025-03-10 01:00:33 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:00:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:00:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:00:44 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:00:48 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:00:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:00:53 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568393, 'download_latency': 1.9097423553466797, 'depth': 0} 2025-03-10 01:00:53 [reviews] INFO: Scraped item: {'review': 'Food was not good. also 475 ml ordered. received 300 ml cold drink.', 'review_id': 284129439, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926} 2025-03-10 01:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19644926&page=1> {'review': 'Food was not good. also 475 ml ordered. received 300 ml cold drink.', 'review_id': 284129439, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926} 2025-03-10 01:00:53 [reviews] INFO: Scraped item: {'review': 'It was tasty but spicy!', 'review_id': 283466731, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926} 2025-03-10 01:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19644926&page=1> {'review': 'It was tasty but spicy!', 'review_id': 283466731, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926} 2025-03-10 01:00:53 [reviews] INFO: Scraped item: {'review': 'bhai yaha khane se acha mat khao please bhai veggies fresh the and rice pura sadd gya tha and noodle is like ehhhhw thats my opinion please take care of your health ', 'review_id': 283463668, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926} 2025-03-10 01:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19644926&page=1> {'review': 'bhai yaha khane se acha mat khao please bhai veggies fresh the and rice pura sadd gya tha and noodle is like ehhhhw thats my opinion please take care of your health ', 'review_id': 283463668, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926} 2025-03-10 01:00:53 [reviews] INFO: Scraped item: {'review': 'The rate is discounted but the quantity is extremely less and not justified even against discount. Had to order more food from other restaurant.', 'review_id': 283093911, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926} 2025-03-10 01:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19644926&page=1> {'review': 'The rate is discounted but the quantity is extremely less and not justified even against discount. Had to order more food from other restaurant.', 'review_id': 283093911, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926} 2025-03-10 01:00:53 [reviews] INFO: Scraped item: {'review': 'found wood stick inside fried rice.. pathetic
avoid ordering food from here.. ', 'review_id': 282449340, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926} 2025-03-10 01:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19644926&page=1> {'review': 'found wood stick inside fried rice.. pathetic
avoid ordering food from here.. ', 'review_id': 282449340, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19644926} 2025-03-10 01:00:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:00:56 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:00:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:00:59 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568404, 'download_latency': 0.8433542251586914, 'depth': 0} 2025-03-10 01:00:59 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284601294, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023} 2025-03-10 01:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19645023&page=1> {'review': '', 'review_id': 284601294, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023} 2025-03-10 01:00:59 [reviews] INFO: Scraped item: {'review': 'The taste of noodles was not as good as served in restaurant. Home delivery food is not fresh and well made', 'review_id': 284051074, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023} 2025-03-10 01:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19645023&page=1> {'review': 'The taste of noodles was not as good as served in restaurant. Home delivery food is not fresh and well made', 'review_id': 284051074, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023} 2025-03-10 01:00:59 [reviews] INFO: Scraped item: {'review': 'Good service by Rahul Bansal.....keep it up', 'review_id': 284039191, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023} 2025-03-10 01:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19645023&page=1> {'review': 'Good service by Rahul Bansal.....keep it up', 'review_id': 284039191, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023} 2025-03-10 01:00:59 [reviews] INFO: Scraped item: {'review': 'Great service by Nihaj. Lovely food', 'review_id': 283643036, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023} 2025-03-10 01:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19645023&page=1> {'review': 'Great service by Nihaj. Lovely food', 'review_id': 283643036, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023} 2025-03-10 01:00:59 [reviews] INFO: Scraped item: {'review': 'Nihaj is really good', 'review_id': 283570304, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023} 2025-03-10 01:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19645023&page=1> {'review': 'Nihaj is really good', 'review_id': 283570304, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'New Delhi', 'sub_zone': 'DLF Avenue (Saket)', 'platform': 'zomato', 'res_id': 19645023} 2025-03-10 01:01:03 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:01:06 [scrapy.extensions.logstats] INFO: Crawled 125 pages (at 6 pages/min), scraped 444 items (at 23 items/min) 2025-03-10 01:01:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:01:07 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 68, 'brand_name': 'Fat Monk Chinese', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 19646158, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568412, 'download_latency': 0.8145511150360107, 'depth': 0} 2025-03-10 01:01:07 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283258473, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 68, 'brand_name': 'Fat Monk Chinese', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 19646158} 2025-03-10 01:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19646158&page=1> {'review': '', 'review_id': 283258473, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 68, 'brand_name': 'Fat Monk Chinese', 'city': 'Mumbai', 'sub_zone': 'Sakinaka', 'platform': 'zomato', 'res_id': 19646158} 2025-03-10 01:01:07 [reviews] INFO: Stopping for res_id: 19646158 as reviews are older than 7 days. 2025-03-10 01:01:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:01:11 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Kandivali', 'platform': 'zomato', 'res_id': 19692864, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568416, 'download_latency': 0.8678240776062012, 'depth': 0} 2025-03-10 01:01:11 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284422655, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Kandivali', 'platform': 'zomato', 'res_id': 19692864} 2025-03-10 01:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19692864&page=1> {'review': '', 'review_id': 284422655, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Kandivali', 'platform': 'zomato', 'res_id': 19692864} 2025-03-10 01:01:11 [reviews] INFO: Scraped item: {'review': "didn't like it", 'review_id': 284377318, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Kandivali', 'platform': 'zomato', 'res_id': 19692864} 2025-03-10 01:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19692864&page=1> {'review': "didn't like it", 'review_id': 284377318, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Kandivali', 'platform': 'zomato', 'res_id': 19692864} 2025-03-10 01:01:11 [reviews] INFO: Stopping for res_id: 19692864 as reviews are older than 7 days. 2025-03-10 01:01:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:01:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:01:18 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568422, 'download_latency': 0.8017070293426514, 'depth': 0} 2025-03-10 01:01:18 [reviews] INFO: Scraped item: {'review': 'Food and service is excellent

Specially Akaash Yadav is too good person', 'review_id': 284560266, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667} 2025-03-10 01:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19709667&page=1> {'review': 'Food and service is excellent

Specially Akaash Yadav is too good person', 'review_id': 284560266, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667} 2025-03-10 01:01:18 [reviews] INFO: Scraped item: {'review': 'Good food', 'review_id': 284482240, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667} 2025-03-10 01:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19709667&page=1> {'review': 'Good food', 'review_id': 284482240, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667} 2025-03-10 01:01:18 [reviews] INFO: Scraped item: {'review': 'Great Food and service , Aakash', 'review_id': 284472323, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667} 2025-03-10 01:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19709667&page=1> {'review': 'Great Food and service , Aakash', 'review_id': 284472323, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667} 2025-03-10 01:01:18 [reviews] INFO: Scraped item: {'review': 'Good restaurant but avoidable on Sunday nights. Street snacks are flavourful although on expensive side.', 'review_id': 284439386, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667} 2025-03-10 01:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19709667&page=1> {'review': 'Good restaurant but avoidable on Sunday nights. Street snacks are flavourful although on expensive side.', 'review_id': 284439386, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667} 2025-03-10 01:01:18 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284364318, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667} 2025-03-10 01:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19709667&page=1> {'review': '', 'review_id': 284364318, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'JUHU', 'platform': 'zomato', 'res_id': 19709667} 2025-03-10 01:01:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:01:23 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:01:25 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:01:29 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:01:32 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:01:36 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:01:40 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:01:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:01:45 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568453, 'download_latency': 0.8293397426605225, 'depth': 0} 2025-03-10 01:01:45 [reviews] INFO: Scraped item: {'review': 'Worst noodles ever i ate', 'review_id': 284140621, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214} 2025-03-10 01:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19745214&page=1> {'review': 'Worst noodles ever i ate', 'review_id': 284140621, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214} 2025-03-10 01:01:45 [reviews] INFO: Scraped item: {'review': 'worthy', 'review_id': 282659612, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214} 2025-03-10 01:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19745214&page=1> {'review': 'worthy', 'review_id': 282659612, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214} 2025-03-10 01:01:45 [reviews] INFO: Scraped item: {'review': 'found a fly ๐Ÿชฐ in hakka noodles', 'review_id': 282551039, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214} 2025-03-10 01:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19745214&page=1> {'review': 'found a fly ๐Ÿชฐ in hakka noodles', 'review_id': 282551039, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 19745214} 2025-03-10 01:01:45 [reviews] INFO: Stopping for res_id: 19745214 as reviews are older than 7 days. 2025-03-10 01:01:48 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:01:51 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:01:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:01:56 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 3, 'brand_name': 'Art Of Dum', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 19769266, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568460, 'download_latency': 0.8958210945129395, 'depth': 0} 2025-03-10 01:01:56 [reviews] INFO: Scraped item: {'review': "The Raita and salan with 2 biryanis (900gm each) was severely insufficient!
This is a constant concern with this eatery!
3 small bottles of raita and salan with almost 2kg biryani... Doesn't make any sense.", 'review_id': 283734090, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 3, 'brand_name': 'Art Of Dum', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 19769266} 2025-03-10 01:01:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19769266&page=1> {'review': "The Raita and salan with 2 biryanis (900gm each) was severely insufficient!
This is a constant concern with this eatery!
3 small bottles of raita and salan with almost 2kg biryani... Doesn't make any sense.", 'review_id': 283734090, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 3, 'brand_name': 'Art Of Dum', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 19769266} 2025-03-10 01:01:56 [reviews] INFO: Scraped item: {'review': 'The presentation is too good and taste is delicious. This was my first time I order from Art of Dum and I loved the favours.', 'review_id': 283052681, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 3, 'brand_name': 'Art Of Dum', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 19769266} 2025-03-10 01:01:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19769266&page=1> {'review': 'The presentation is too good and taste is delicious. This was my first time I order from Art of Dum and I loved the favours.', 'review_id': 283052681, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 3, 'brand_name': 'Art Of Dum', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 19769266} 2025-03-10 01:01:56 [reviews] INFO: Stopping for res_id: 19769266 as reviews are older than 7 days. 2025-03-10 01:01:59 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:02:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:02:03 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568467, 'download_latency': 0.8463470935821533, 'depth': 0} 2025-03-10 01:02:03 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284359540, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717} 2025-03-10 01:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19832717&page=1> {'review': '', 'review_id': 284359540, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717} 2025-03-10 01:02:03 [reviews] INFO: Scraped item: {'review': 'undercooked and salty food', 'review_id': 284079973, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717} 2025-03-10 01:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19832717&page=1> {'review': 'undercooked and salty food', 'review_id': 284079973, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717} 2025-03-10 01:02:03 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283749803, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717} 2025-03-10 01:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19832717&page=1> {'review': '', 'review_id': 283749803, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717} 2025-03-10 01:02:03 [reviews] INFO: Scraped item: {'review': 'food is good but delivery charges are very expensive ', 'review_id': 282918125, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717} 2025-03-10 01:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19832717&page=1> {'review': 'food is good but delivery charges are very expensive ', 'review_id': 282918125, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717} 2025-03-10 01:02:03 [reviews] INFO: Scraped item: {'review': 'Worst chocolava ever had it was not cooked properly', 'review_id': 282664642, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717} 2025-03-10 01:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19832717&page=1> {'review': 'Worst chocolava ever had it was not cooked properly', 'review_id': 282664642, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 19832717} 2025-03-10 01:02:06 [scrapy.extensions.logstats] INFO: Crawled 131 pages (at 6 pages/min), scraped 462 items (at 18 items/min) 2025-03-10 01:02:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:02:07 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19845961, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568471, 'download_latency': 0.8382077217102051, 'depth': 0} 2025-03-10 01:02:07 [reviews] INFO: Scraped item: {'review': 'soya chaap biryani was amazing from biryani by kilo โค๏ธ', 'review_id': 283818199, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19845961} 2025-03-10 01:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19845961&page=1> {'review': 'soya chaap biryani was amazing from biryani by kilo โค๏ธ', 'review_id': 283818199, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19845961} 2025-03-10 01:02:07 [reviews] INFO: Scraped item: {'review': 'taste less , less quantity ', 'review_id': 283120890, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19845961} 2025-03-10 01:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19845961&page=1> {'review': 'taste less , less quantity ', 'review_id': 283120890, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19845961} 2025-03-10 01:02:07 [reviews] INFO: Scraped item: {'review': 'Not worth , the rice was over cooked and it was like lump', 'review_id': 282858677, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19845961} 2025-03-10 01:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19845961&page=1> {'review': 'Not worth , the rice was over cooked and it was like lump', 'review_id': 282858677, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 19845961} 2025-03-10 01:02:07 [reviews] INFO: Stopping for res_id: 19845961 as reviews are older than 7 days. 2025-03-10 01:02:11 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:02:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:02:15 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'MumbaiMumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 19855416, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568478, 'download_latency': 0.8131136894226074, 'depth': 0} 2025-03-10 01:02:15 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284576917, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'MumbaiMumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 19855416} 2025-03-10 01:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19855416&page=1> {'review': '', 'review_id': 284576917, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'MumbaiMumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 19855416} 2025-03-10 01:02:15 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284524548, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'MumbaiMumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 19855416} 2025-03-10 01:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19855416&page=1> {'review': '', 'review_id': 284524548, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'MumbaiMumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 19855416} 2025-03-10 01:02:15 [reviews] INFO: Scraped item: {'review': 'Very bad', 'review_id': 283561250, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'MumbaiMumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 19855416} 2025-03-10 01:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19855416&page=1> {'review': 'Very bad', 'review_id': 283561250, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'MumbaiMumbai', 'sub_zone': 'Chowpatty', 'platform': 'zomato', 'res_id': 19855416} 2025-03-10 01:02:15 [reviews] INFO: Stopping for res_id: 19855416 as reviews are older than 7 days. 2025-03-10 01:02:17 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:02:21 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:02:25 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:02:28 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:02:32 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:02:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:02:37 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568497, 'download_latency': 0.814180850982666, 'depth': 0} 2025-03-10 01:02:37 [reviews] INFO: Scraped item: {'review': 'not at all tasty very dry.
2 points only for good packaging and somewhat hygienic.', 'review_id': 284584340, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363} 2025-03-10 01:02:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19856363&page=1> {'review': 'not at all tasty very dry.
2 points only for good packaging and somewhat hygienic.', 'review_id': 284584340, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363} 2025-03-10 01:02:37 [reviews] INFO: Scraped item: {'review': 'Manchurian had more maida, instead of being crispy & soft. Better be careful next time onwards.', 'review_id': 284499731, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363} 2025-03-10 01:02:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19856363&page=1> {'review': 'Manchurian had more maida, instead of being crispy & soft. Better be careful next time onwards.', 'review_id': 284499731, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363} 2025-03-10 01:02:37 [reviews] INFO: Scraped item: {'review': 'only rice sended ', 'review_id': 284387741, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363} 2025-03-10 01:02:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19856363&page=1> {'review': 'only rice sended ', 'review_id': 284387741, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363} 2025-03-10 01:02:37 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284186659, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363} 2025-03-10 01:02:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19856363&page=1> {'review': '', 'review_id': 284186659, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363} 2025-03-10 01:02:37 [reviews] INFO: Scraped item: {'review': 'very bad experience ๐Ÿ˜ž', 'review_id': 284008835, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363} 2025-03-10 01:02:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19856363&page=1> {'review': 'very bad experience ๐Ÿ˜ž', 'review_id': 284008835, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 19856363} 2025-03-10 01:02:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:02:41 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568501, 'download_latency': 1.1843724250793457, 'depth': 0} 2025-03-10 01:02:41 [reviews] INFO: Scraped item: {'review': 'wrong item send ', 'review_id': 284582231, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306} 2025-03-10 01:02:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19894306&page=1> {'review': 'wrong item send ', 'review_id': 284582231, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306} 2025-03-10 01:02:41 [reviews] INFO: Scraped item: {'review': 'just go for this biriyani finally found a Kolkata style proper dum biryani ', 'review_id': 284545970, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306} 2025-03-10 01:02:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19894306&page=1> {'review': 'just go for this biriyani finally found a Kolkata style proper dum biryani ', 'review_id': 284545970, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306} 2025-03-10 01:02:41 [reviews] INFO: Scraped item: {'review': "Salan wasn't the best.", 'review_id': 284286893, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306} 2025-03-10 01:02:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19894306&page=1> {'review': "Salan wasn't the best.", 'review_id': 284286893, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306} 2025-03-10 01:02:41 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283993857, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306} 2025-03-10 01:02:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19894306&page=1> {'review': '', 'review_id': 283993857, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306} 2025-03-10 01:02:41 [reviews] INFO: Scraped item: {'review': 'very good taste ๐Ÿ‘', 'review_id': 283550531, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306} 2025-03-10 01:02:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19894306&page=1> {'review': 'very good taste ๐Ÿ‘', 'review_id': 283550531, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Gurgaon ', 'sub_zone': 'Baani Sqaure,Sector 50', 'platform': 'zomato', 'res_id': 19894306} 2025-03-10 01:02:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:02:45 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568506, 'download_latency': 0.8562679290771484, 'depth': 0} 2025-03-10 01:02:45 [reviews] INFO: Scraped item: {'review': 'The size of the ghevar has been reduced drastically and the richness of the dish has gone down. I was a huge fan, felt disappointed for the first time.', 'review_id': 284330402, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697} 2025-03-10 01:02:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19931697&page=1> {'review': 'The size of the ghevar has been reduced drastically and the richness of the dish has gone down. I was a huge fan, felt disappointed for the first time.', 'review_id': 284330402, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697} 2025-03-10 01:02:45 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284102980, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697} 2025-03-10 01:02:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19931697&page=1> {'review': '', 'review_id': 284102980, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697} 2025-03-10 01:02:45 [reviews] INFO: Scraped item: {'review': 'not worth it', 'review_id': 283510040, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697} 2025-03-10 01:02:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19931697&page=1> {'review': 'not worth it', 'review_id': 283510040, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697} 2025-03-10 01:02:45 [reviews] INFO: Scraped item: {'review': 'Ramzan gifting just got more special. Meetha by Radisson has come up with a Ramzan gifting hamper that is sure to wow your friends and family. Not only does it spell luxury in every way, it also contains your classic Ramzan items - Falooda, Firni, an assortment of sweets, Farsan, Malpua and my favourite from this: the Laccha Rabdi. So be it corporate gifting or sending love for friends and family, this is the Ramzan hamper you must check out!', 'review_id': 283232659, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-06', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697} 2025-03-10 01:02:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19931697&page=1> {'review': 'Ramzan gifting just got more special. Meetha by Radisson has come up with a Ramzan gifting hamper that is sure to wow your friends and family. Not only does it spell luxury in every way, it also contains your classic Ramzan items - Falooda, Firni, an assortment of sweets, Farsan, Malpua and my favourite from this: the Laccha Rabdi. So be it corporate gifting or sending love for friends and family, this is the Ramzan hamper you must check out!', 'review_id': 283232659, 'rating': '4', 'review_type': 'DINING', 'review_date': '2025-03-06', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697} 2025-03-10 01:02:45 [reviews] INFO: Scraped item: {'review': 'The samosas were not good', 'review_id': 282953502, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697} 2025-03-10 01:02:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=19931697&page=1> {'review': 'The samosas were not good', 'review_id': 282953502, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Goregaon West', 'platform': 'zomato', 'res_id': 19931697} 2025-03-10 01:02:48 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:02:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:02:54 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568512, 'download_latency': 2.7207396030426025, 'depth': 0} 2025-03-10 01:02:54 [reviews] INFO: Scraped item: {'review': 'Worst biryani ever.....seems like boiled rice instead tasted veryyyyy badddd i want refund of this', 'review_id': 284566070, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341} 2025-03-10 01:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20020341&page=1> {'review': 'Worst biryani ever.....seems like boiled rice instead tasted veryyyyy badddd i want refund of this', 'review_id': 284566070, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341} 2025-03-10 01:02:54 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284158072, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341} 2025-03-10 01:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20020341&page=1> {'review': '', 'review_id': 284158072, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341} 2025-03-10 01:02:54 [reviews] INFO: Scraped item: {'review': 'Didnt send cutlery when in the adress i clearly mentioned hotel......had to blinket extra cutlery.', 'review_id': 284155392, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341} 2025-03-10 01:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20020341&page=1> {'review': 'Didnt send cutlery when in the adress i clearly mentioned hotel......had to blinket extra cutlery.', 'review_id': 284155392, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341} 2025-03-10 01:02:54 [reviews] INFO: Scraped item: {'review': 'It tastes delicious with good packaging but the quantity is not much as per the price.', 'review_id': 284145497, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341} 2025-03-10 01:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20020341&page=1> {'review': 'It tastes delicious with good packaging but the quantity is not much as per the price.', 'review_id': 284145497, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341} 2025-03-10 01:02:54 [reviews] INFO: Scraped item: {'review': 'Served burnt food', 'review_id': 283107612, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341} 2025-03-10 01:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20020341&page=1> {'review': 'Served burnt food', 'review_id': 283107612, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20020341} 2025-03-10 01:02:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:02:57 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 36, 'brand_name': 'Slay Coffee Bar', 'city': 'Bangalore', 'sub_zone': 'RMZ Millenia', 'platform': 'zomato', 'res_id': 20086621, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568516, 'download_latency': 1.1125843524932861, 'depth': 0} 2025-03-10 01:02:57 [reviews] INFO: Stopping for res_id: 20086621 as reviews are older than 7 days. 2025-03-10 01:03:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:03:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:03:04 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 26, 'brand_name': 'Starbucks Coffee', 'city': 'Bangalore', 'sub_zone': 'Garuda Mall', 'platform': 'zomato', 'res_id': 20214336, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568524, 'download_latency': 1.354407548904419, 'depth': 0} 2025-03-10 01:03:04 [reviews] INFO: Stopping for res_id: 20214336 as reviews are older than 7 days. 2025-03-10 01:03:06 [scrapy.extensions.logstats] INFO: Crawled 139 pages (at 8 pages/min), scraped 488 items (at 26 items/min) 2025-03-10 01:03:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:03:12 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:03:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:03:15 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 20227195, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568535, 'download_latency': 0.880868673324585, 'depth': 0} 2025-03-10 01:03:15 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284361334, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 20227195} 2025-03-10 01:03:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20227195&page=1> {'review': '', 'review_id': 284361334, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 19, 'brand_name': 'Borivali Biryani Centre', 'city': 'Mumbai', 'sub_zone': 'Borivali West', 'platform': 'zomato', 'res_id': 20227195} 2025-03-10 01:03:15 [reviews] INFO: Stopping for res_id: 20227195 as reviews are older than 7 days. 2025-03-10 01:03:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:03:23 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:03:26 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:03:30 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:03:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:03:34 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Vikhroli', 'platform': 'zomato', 'res_id': 20248171, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568553, 'download_latency': 0.8791391849517822, 'depth': 0} 2025-03-10 01:03:34 [reviews] ERROR: Unrecognized relative_date format: aug 27, 2023 2025-03-10 01:03:34 [reviews] INFO: Stopping for res_id: 20248171 due to unrecognized date format: Aug 27, 2023. 2025-03-10 01:03:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:03:37 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 32, 'brand_name': 'Third Wave Coffee', 'city': 'Bangalore', 'sub_zone': 'Lavelle Road', 'platform': 'zomato', 'res_id': 20265082, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568558, 'download_latency': 0.7730588912963867, 'depth': 0} 2025-03-10 01:03:38 [reviews] INFO: Stopping for res_id: 20265082 as reviews are older than 7 days. 2025-03-10 01:03:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:03:45 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:03:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:03:53 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:03:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:04:01 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:04:06 [scrapy.extensions.logstats] INFO: Crawled 142 pages (at 3 pages/min), scraped 489 items (at 1 items/min) 2025-03-10 01:04:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:04:06 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 20267173, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568585, 'download_latency': 0.8218791484832764, 'depth': 0} 2025-03-10 01:04:06 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284265828, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 20267173} 2025-03-10 01:04:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20267173&page=1> {'review': '', 'review_id': 284265828, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 20267173} 2025-03-10 01:04:06 [reviews] INFO: Scraped item: {'review': 'No sauces send .The rice was cold .The taste was bland', 'review_id': 282511357, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 20267173} 2025-03-10 01:04:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20267173&page=1> {'review': 'No sauces send .The rice was cold .The taste was bland', 'review_id': 282511357, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 20267173} 2025-03-10 01:04:06 [reviews] INFO: Scraped item: {'review': 'I got sweet corn chicken instead of prawns', 'review_id': 282488488, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 20267173} 2025-03-10 01:04:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20267173&page=1> {'review': 'I got sweet corn chicken instead of prawns', 'review_id': 282488488, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Oshiwara', 'platform': 'zomato', 'res_id': 20267173} 2025-03-10 01:04:06 [reviews] INFO: Stopping for res_id: 20267173 as reviews are older than 7 days. 2025-03-10 01:04:09 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:04:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:04:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:04:18 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'FUNREPUBLIC MALL', 'platform': 'zomato', 'res_id': 20284206, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568595, 'download_latency': 0.7816143035888672, 'depth': 0} 2025-03-10 01:04:18 [reviews] INFO: Scraped item: {'review': 'Nehal service was extremely good and friendly', 'review_id': 284479053, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'FUNREPUBLIC MALL', 'platform': 'zomato', 'res_id': 20284206} 2025-03-10 01:04:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20284206&page=1> {'review': 'Nehal service was extremely good and friendly', 'review_id': 284479053, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'FUNREPUBLIC MALL', 'platform': 'zomato', 'res_id': 20284206} 2025-03-10 01:04:18 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284423554, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'FUNREPUBLIC MALL', 'platform': 'zomato', 'res_id': 20284206} 2025-03-10 01:04:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20284206&page=1> {'review': '', 'review_id': 284423554, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'FUNREPUBLIC MALL', 'platform': 'zomato', 'res_id': 20284206} 2025-03-10 01:04:18 [reviews] INFO: Scraped item: {'review': 'very good service ', 'review_id': 284328576, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'FUNREPUBLIC MALL', 'platform': 'zomato', 'res_id': 20284206} 2025-03-10 01:04:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20284206&page=1> {'review': 'very good service ', 'review_id': 284328576, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'FUNREPUBLIC MALL', 'platform': 'zomato', 'res_id': 20284206} 2025-03-10 01:04:18 [reviews] INFO: Scraped item: {'review': 'Nehal was good . Nice experience', 'review_id': 284323569, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'FUNREPUBLIC MALL', 'platform': 'zomato', 'res_id': 20284206} 2025-03-10 01:04:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20284206&page=1> {'review': 'Nehal was good . Nice experience', 'review_id': 284323569, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'FUNREPUBLIC MALL', 'platform': 'zomato', 'res_id': 20284206} 2025-03-10 01:04:18 [reviews] INFO: Scraped item: {'review': 'Kaynul is excellent host', 'review_id': 284304068, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'FUNREPUBLIC MALL', 'platform': 'zomato', 'res_id': 20284206} 2025-03-10 01:04:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20284206&page=1> {'review': 'Kaynul is excellent host', 'review_id': 284304068, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'FUNREPUBLIC MALL', 'platform': 'zomato', 'res_id': 20284206} 2025-03-10 01:04:21 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:04:25 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:04:29 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:04:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:04:33 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Palladium Mall (Lower Parel)', 'platform': 'zomato', 'res_id': 20340568, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568610, 'download_latency': 0.7955541610717773, 'depth': 0} 2025-03-10 01:04:33 [reviews] INFO: Scraped item: {'review': 'really food was very bad ', 'review_id': 283796133, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Palladium Mall (Lower Parel)', 'platform': 'zomato', 'res_id': 20340568} 2025-03-10 01:04:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20340568&page=1> {'review': 'really food was very bad ', 'review_id': 283796133, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Palladium Mall (Lower Parel)', 'platform': 'zomato', 'res_id': 20340568} 2025-03-10 01:04:33 [reviews] INFO: Scraped item: {'review': 'Worst food and service at this outlet', 'review_id': 283703036, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Palladium Mall (Lower Parel)', 'platform': 'zomato', 'res_id': 20340568} 2025-03-10 01:04:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20340568&page=1> {'review': 'Worst food and service at this outlet', 'review_id': 283703036, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Palladium Mall (Lower Parel)', 'platform': 'zomato', 'res_id': 20340568} 2025-03-10 01:04:33 [reviews] INFO: Scraped item: {'review': 'loved the chicken fried rice with chilli chicken ', 'review_id': 282604655, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-04', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Palladium Mall (Lower Parel)', 'platform': 'zomato', 'res_id': 20340568} 2025-03-10 01:04:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20340568&page=1> {'review': 'loved the chicken fried rice with chilli chicken ', 'review_id': 282604655, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-04', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Palladium Mall (Lower Parel)', 'platform': 'zomato', 'res_id': 20340568} 2025-03-10 01:04:33 [reviews] INFO: Stopping for res_id: 20340568 as reviews are older than 7 days. 2025-03-10 01:04:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:04:37 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568614, 'download_latency': 0.9324080944061279, 'depth': 0} 2025-03-10 01:04:37 [reviews] INFO: Scraped item: {'review': 'awesome ', 'review_id': 284569508, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424} 2025-03-10 01:04:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20358424&page=1> {'review': 'awesome ', 'review_id': 284569508, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424} 2025-03-10 01:04:37 [reviews] INFO: Scraped item: {'review': 'Authentic Kolkata Biryani served', 'review_id': 284564202, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424} 2025-03-10 01:04:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20358424&page=1> {'review': 'Authentic Kolkata Biryani served', 'review_id': 284564202, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424} 2025-03-10 01:04:37 [reviews] INFO: Scraped item: {'review': 'Worst chicken pieces', 'review_id': 284481692, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424} 2025-03-10 01:04:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20358424&page=1> {'review': 'Worst chicken pieces', 'review_id': 284481692, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424} 2025-03-10 01:04:37 [reviews] INFO: Scraped item: {'review': 'add more rice also', 'review_id': 284418506, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424} 2025-03-10 01:04:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20358424&page=1> {'review': 'add more rice also', 'review_id': 284418506, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424} 2025-03-10 01:04:37 [reviews] INFO: Scraped item: {'review': 'Excellent biryani as always. Literally not a single biryani from this place is average.kudos to this place', 'review_id': 284088704, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424} 2025-03-10 01:04:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20358424&page=1> {'review': 'Excellent biryani as always. Literally not a single biryani from this place is average.kudos to this place', 'review_id': 284088704, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20358424} 2025-03-10 01:04:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:04:40 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568618, 'download_latency': 0.8611528873443604, 'depth': 0} 2025-03-10 01:04:40 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284475345, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081} 2025-03-10 01:04:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20388081&page=1> {'review': '', 'review_id': 284475345, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081} 2025-03-10 01:04:40 [reviews] INFO: Scraped item: {'review': 'A lot of oil', 'review_id': 284018889, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081} 2025-03-10 01:04:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20388081&page=1> {'review': 'A lot of oil', 'review_id': 284018889, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081} 2025-03-10 01:04:40 [reviews] INFO: Scraped item: {'review': 'Anuj Chohan served well and kind enough to suggest dishes to try. Thank you', 'review_id': 283687153, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081} 2025-03-10 01:04:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20388081&page=1> {'review': 'Anuj Chohan served well and kind enough to suggest dishes to try. Thank you', 'review_id': 283687153, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081} 2025-03-10 01:04:40 [reviews] INFO: Scraped item: {'review': 'Loved it great food great vibes', 'review_id': 283117711, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-06', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081} 2025-03-10 01:04:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20388081&page=1> {'review': 'Loved it great food great vibes', 'review_id': 283117711, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-06', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081} 2025-03-10 01:04:40 [reviews] INFO: Scraped item: {'review': 'Soup was too salty', 'review_id': 283032171, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081} 2025-03-10 01:04:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20388081&page=1> {'review': 'Soup was too salty', 'review_id': 283032171, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Mumbai', 'sub_zone': 'Powai', 'platform': 'zomato', 'res_id': 20388081} 2025-03-10 01:04:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:04:45 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:04:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:04:53 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:04:56 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:05:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:05:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:05:05 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Mira Road', 'platform': 'zomato', 'res_id': 20420004, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568647, 'download_latency': 2.7295145988464355, 'depth': 0} 2025-03-10 01:05:05 [reviews] ERROR: Error parsing date: an hour ago, error: unsupported type for timedelta hours component: NoneType 2025-03-10 01:05:05 [reviews] INFO: Stopping for res_id: 20420004 due to unrecognized date format: an hour ago. 2025-03-10 01:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-10 01:05:06 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-10 01:05:06 [scrapy.extensions.logstats] INFO: Crawled 148 pages (at 6 pages/min), scraped 510 items (at 21 items/min) 2025-03-10 01:05:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:05:11 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:05:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:05:16 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 31, 'brand_name': 'Twenty Seven Bake House', 'city': 'Mumbai', 'sub_zone': 'Mahalaxmi', 'platform': 'zomato', 'res_id': 20420093, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568659, 'download_latency': 1.2804784774780273, 'depth': 0} 2025-03-10 01:05:16 [reviews] INFO: Stopping for res_id: 20420093 as reviews are older than 7 days. 2025-03-10 01:05:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:05:23 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:05:26 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:05:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:05:31 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568673, 'download_latency': 1.4311370849609375, 'depth': 0} 2025-03-10 01:05:31 [reviews] INFO: Scraped item: {'review': 'Very late.... 30 minutes later than expected and hence food was cold', 'review_id': 284115991, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117} 2025-03-10 01:05:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20440117&page=1> {'review': 'Very late.... 30 minutes later than expected and hence food was cold', 'review_id': 284115991, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117} 2025-03-10 01:05:31 [reviews] INFO: Scraped item: {'review': 'not very great ', 'review_id': 284093773, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117} 2025-03-10 01:05:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20440117&page=1> {'review': 'not very great ', 'review_id': 284093773, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117} 2025-03-10 01:05:31 [reviews] INFO: Scraped item: {'review': 'Great', 'review_id': 283951029, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117} 2025-03-10 01:05:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20440117&page=1> {'review': 'Great', 'review_id': 283951029, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117} 2025-03-10 01:05:31 [reviews] INFO: Scraped item: {'review': 'Too much oil', 'review_id': 283910374, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117} 2025-03-10 01:05:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20440117&page=1> {'review': 'Too much oil', 'review_id': 283910374, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117} 2025-03-10 01:05:31 [reviews] INFO: Scraped item: {'review': 'quality deterioration ', 'review_id': 283738898, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117} 2025-03-10 01:05:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20440117&page=1> {'review': 'quality deterioration ', 'review_id': 283738898, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 57, 'brand_name': 'Chinese Wok', 'city': 'Mumbai', 'sub_zone': '7 Bungalows', 'platform': 'zomato', 'res_id': 20440117} 2025-03-10 01:05:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:05:35 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20448735, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568677, 'download_latency': 0.9574801921844482, 'depth': 0} 2025-03-10 01:05:35 [reviews] INFO: Scraped item: {'review': 'Missing items ! No concerned person from either zomato or Magnolia', 'review_id': 284372793, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20448735} 2025-03-10 01:05:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20448735&page=1> {'review': 'Missing items ! No concerned person from either zomato or Magnolia', 'review_id': 284372793, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20448735} 2025-03-10 01:05:35 [reviews] INFO: Scraped item: {'review': 'Worst staff n manager ridiculous behaviour by them no respect to customer needs', 'review_id': 284303782, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20448735} 2025-03-10 01:05:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20448735&page=1> {'review': 'Worst staff n manager ridiculous behaviour by them no respect to customer needs', 'review_id': 284303782, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20448735} 2025-03-10 01:05:35 [reviews] INFO: Scraped item: {'review': '', 'review_id': 282843753, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20448735} 2025-03-10 01:05:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20448735&page=1> {'review': '', 'review_id': 282843753, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20448735} 2025-03-10 01:05:35 [reviews] INFO: Stopping for res_id: 20448735 as reviews are older than 7 days. 2025-03-10 01:05:38 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:05:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:05:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:05:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:05:53 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:05:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:06:01 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:06:04 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:06:06 [scrapy.extensions.logstats] INFO: Crawled 151 pages (at 3 pages/min), scraped 518 items (at 8 items/min) 2025-03-10 01:06:08 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:06:12 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:06:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:06:17 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 32, 'brand_name': 'Third Wave Coffee', 'city': 'Mumbai', 'sub_zone': 'Colaba', 'platform': 'zomato', 'res_id': 20509246, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568717, 'download_latency': 1.5097978115081787, 'depth': 0} 2025-03-10 01:06:17 [reviews] INFO: Scraped item: {'review': '๐Ÿ‘๐Ÿป', 'review_id': 283482029, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 32, 'brand_name': 'Third Wave Coffee', 'city': 'Mumbai', 'sub_zone': 'Colaba', 'platform': 'zomato', 'res_id': 20509246} 2025-03-10 01:06:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20509246&page=1> {'review': '๐Ÿ‘๐Ÿป', 'review_id': 283482029, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 32, 'brand_name': 'Third Wave Coffee', 'city': 'Mumbai', 'sub_zone': 'Colaba', 'platform': 'zomato', 'res_id': 20509246} 2025-03-10 01:06:17 [reviews] INFO: Stopping for res_id: 20509246 as reviews are older than 7 days. 2025-03-10 01:06:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:06:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:06:29 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:06:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:06:33 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568732, 'download_latency': 1.1866159439086914, 'depth': 0} 2025-03-10 01:06:33 [reviews] INFO: Scraped item: {'review': 'The restaurant delay the service for 1 hour', 'review_id': 284518481, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112} 2025-03-10 01:06:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20516112&page=1> {'review': 'The restaurant delay the service for 1 hour', 'review_id': 284518481, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112} 2025-03-10 01:06:33 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284518384, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112} 2025-03-10 01:06:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20516112&page=1> {'review': '', 'review_id': 284518384, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112} 2025-03-10 01:06:33 [reviews] INFO: Scraped item: {'review': 'not good in test ', 'review_id': 284499260, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112} 2025-03-10 01:06:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20516112&page=1> {'review': 'not good in test ', 'review_id': 284499260, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112} 2025-03-10 01:06:33 [reviews] INFO: Scraped item: {'review': "Didn't received the order itself ", 'review_id': 284475290, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112} 2025-03-10 01:06:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20516112&page=1> {'review': "Didn't received the order itself ", 'review_id': 284475290, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112} 2025-03-10 01:06:33 [reviews] INFO: Scraped item: {'review': 'Good', 'review_id': 284472700, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112} 2025-03-10 01:06:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20516112&page=1> {'review': 'Good', 'review_id': 284472700, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Pune', 'sub_zone': 'Camp', 'platform': 'zomato', 'res_id': 20516112} 2025-03-10 01:06:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:06:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:06:44 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:06:47 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:06:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:06:53 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:06:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:07:01 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:07:04 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:07:06 [scrapy.extensions.logstats] INFO: Crawled 153 pages (at 2 pages/min), scraped 524 items (at 6 items/min) 2025-03-10 01:07:08 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:07:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:07:14 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 35, 'brand_name': 'True Black Specialty Coffee', 'city': 'Hyderabad ', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 20517056, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568772, 'download_latency': 1.6678061485290527, 'depth': 0} 2025-03-10 01:07:14 [reviews] INFO: Stopping for res_id: 20517056 as reviews are older than 7 days. 2025-03-10 01:07:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:07:18 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568778, 'download_latency': 0.8783996105194092, 'depth': 0} 2025-03-10 01:07:18 [reviews] INFO: Scraped item: {'review': 'So sad it was very bad so much oil i ordered crispy hunan chicken and dont knw what has been sent so bad not eatable i hve visted ur restaurant and have eaten this before but this is not the same thing plzzz guys we pay so much including taxes', 'review_id': 284531524, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146} 2025-03-10 01:07:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517146&page=1> {'review': 'So sad it was very bad so much oil i ordered crispy hunan chicken and dont knw what has been sent so bad not eatable i hve visted ur restaurant and have eaten this before but this is not the same thing plzzz guys we pay so much including taxes', 'review_id': 284531524, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146} 2025-03-10 01:07:18 [reviews] INFO: Scraped item: {'review': 'Fried rice is too dry', 'review_id': 284495077, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146} 2025-03-10 01:07:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517146&page=1> {'review': 'Fried rice is too dry', 'review_id': 284495077, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146} 2025-03-10 01:07:18 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284046171, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146} 2025-03-10 01:07:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517146&page=1> {'review': '', 'review_id': 284046171, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146} 2025-03-10 01:07:18 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283370295, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146} 2025-03-10 01:07:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517146&page=1> {'review': '', 'review_id': 283370295, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146} 2025-03-10 01:07:18 [reviews] INFO: Scraped item: {'review': 'Too too tooo salty and oily. Highly disappointed with the quality of 5 spice', 'review_id': 283052109, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146} 2025-03-10 01:07:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20517146&page=1> {'review': 'Too too tooo salty and oily. Highly disappointed with the quality of 5 spice', 'review_id': 283052109, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 58, 'brand_name': '5 Spice', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 20517146} 2025-03-10 01:07:21 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:07:25 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:07:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:07:30 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 51, 'brand_name': 'Soba Sassy', 'city': 'Kolkata', 'sub_zone': 'Camac Street Area', 'platform': 'zomato', 'res_id': 20528405, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568789, 'download_latency': 0.7872879505157471, 'depth': 0} 2025-03-10 01:07:30 [reviews] INFO: Scraped item: {'review': '', 'review_id': 282507931, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 51, 'brand_name': 'Soba Sassy', 'city': 'Kolkata', 'sub_zone': 'Camac Street Area', 'platform': 'zomato', 'res_id': 20528405} 2025-03-10 01:07:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20528405&page=1> {'review': '', 'review_id': 282507931, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 51, 'brand_name': 'Soba Sassy', 'city': 'Kolkata', 'sub_zone': 'Camac Street Area', 'platform': 'zomato', 'res_id': 20528405} 2025-03-10 01:07:30 [reviews] INFO: Stopping for res_id: 20528405 as reviews are older than 7 days. 2025-03-10 01:07:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:07:34 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Veera Desai Area', 'platform': 'zomato', 'res_id': 20541482, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568794, 'download_latency': 0.7471120357513428, 'depth': 0} 2025-03-10 01:07:34 [reviews] INFO: Scraped item: {'review': 'Ordered Veg Hyderabadi Dum Biryani and it surpassed my expectations. It was too good and served hot. ', 'review_id': 284540838, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Veera Desai Area', 'platform': 'zomato', 'res_id': 20541482} 2025-03-10 01:07:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20541482&page=1> {'review': 'Ordered Veg Hyderabadi Dum Biryani and it surpassed my expectations. It was too good and served hot. ', 'review_id': 284540838, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Veera Desai Area', 'platform': 'zomato', 'res_id': 20541482} 2025-03-10 01:07:34 [reviews] INFO: Scraped item: {'review': 'very good ๐Ÿ‘ ', 'review_id': 284445862, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Veera Desai Area', 'platform': 'zomato', 'res_id': 20541482} 2025-03-10 01:07:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20541482&page=1> {'review': 'very good ๐Ÿ‘ ', 'review_id': 284445862, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Veera Desai Area', 'platform': 'zomato', 'res_id': 20541482} 2025-03-10 01:07:34 [reviews] INFO: Scraped item: {'review': 'baf ', 'review_id': 284353238, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Veera Desai Area', 'platform': 'zomato', 'res_id': 20541482} 2025-03-10 01:07:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20541482&page=1> {'review': 'baf ', 'review_id': 284353238, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Veera Desai Area', 'platform': 'zomato', 'res_id': 20541482} 2025-03-10 01:07:34 [reviews] INFO: Scraped item: {'review': 'lot of salt ', 'review_id': 284221017, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Veera Desai Area', 'platform': 'zomato', 'res_id': 20541482} 2025-03-10 01:07:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20541482&page=1> {'review': 'lot of salt ', 'review_id': 284221017, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Veera Desai Area', 'platform': 'zomato', 'res_id': 20541482} 2025-03-10 01:07:34 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284193743, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Veera Desai Area', 'platform': 'zomato', 'res_id': 20541482} 2025-03-10 01:07:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20541482&page=1> {'review': '', 'review_id': 284193743, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Mumbai', 'sub_zone': 'Veera Desai Area', 'platform': 'zomato', 'res_id': 20541482} 2025-03-10 01:07:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:07:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:07:44 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:07:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:07:53 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:07:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:07:59 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:08:03 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:08:06 [scrapy.extensions.logstats] INFO: Crawled 157 pages (at 4 pages/min), scraped 535 items (at 11 items/min) 2025-03-10 01:08:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:08:07 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Inorbit Mall', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20587336, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568825, 'download_latency': 0.7970983982086182, 'depth': 0} 2025-03-10 01:08:07 [reviews] INFO: Scraped item: {'review': 'nice work ', 'review_id': 284151075, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Inorbit Mall', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20587336} 2025-03-10 01:08:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20587336&page=1> {'review': 'nice work ', 'review_id': 284151075, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Inorbit Mall', 'sub_zone': 'Malad West', 'platform': 'zomato', 'res_id': 20587336} 2025-03-10 01:08:07 [reviews] INFO: Stopping for res_id: 20587336 as reviews are older than 7 days. 2025-03-10 01:08:10 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:08:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:08:15 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 20646811, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568835, 'download_latency': 0.7686431407928467, 'depth': 0} 2025-03-10 01:08:15 [reviews] INFO: Scraped item: {'review': 'Look how the pasta looks, no toppings, no oregano nothing', 'review_id': 283761811, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 20646811} 2025-03-10 01:08:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20646811&page=1> {'review': 'Look how the pasta looks, no toppings, no oregano nothing', 'review_id': 283761811, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 20646811} 2025-03-10 01:08:15 [reviews] INFO: Scraped item: {'review': 'Garlic bread had no butter', 'review_id': 283730585, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 20646811} 2025-03-10 01:08:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20646811&page=1> {'review': 'Garlic bread had no butter', 'review_id': 283730585, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 20646811} 2025-03-10 01:08:15 [reviews] INFO: Stopping for res_id: 20646811 as reviews are older than 7 days. 2025-03-10 01:08:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:08:19 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568838, 'download_latency': 0.7300395965576172, 'depth': 0} 2025-03-10 01:08:19 [reviews] INFO: Scraped item: {'review': 'I found pieces of non veg in their paneer biryani', 'review_id': 284613436, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045} 2025-03-10 01:08:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20660045&page=1> {'review': 'I found pieces of non veg in their paneer biryani', 'review_id': 284613436, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045} 2025-03-10 01:08:19 [reviews] INFO: Scraped item: {'review': "the images shown on app are totally at variance with what they deliver and I don't know how zomato rates the restaurant has 4 and above", 'review_id': 284541323, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045} 2025-03-10 01:08:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20660045&page=1> {'review': "the images shown on app are totally at variance with what they deliver and I don't know how zomato rates the restaurant has 4 and above", 'review_id': 284541323, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045} 2025-03-10 01:08:19 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284529015, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045} 2025-03-10 01:08:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20660045&page=1> {'review': '', 'review_id': 284529015, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045} 2025-03-10 01:08:19 [reviews] INFO: Scraped item: {'review': 'i order most of time from them only. but today it want worth. seem like stalled. Paneers were smelly. ', 'review_id': 284335615, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045} 2025-03-10 01:08:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20660045&page=1> {'review': 'i order most of time from them only. but today it want worth. seem like stalled. Paneers were smelly. ', 'review_id': 284335615, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045} 2025-03-10 01:08:19 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284190278, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045} 2025-03-10 01:08:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20660045&page=1> {'review': '', 'review_id': 284190278, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Tilak Nagar', 'platform': 'zomato', 'res_id': 20660045} 2025-03-10 01:08:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:08:26 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:08:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:08:30 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 37, 'brand_name': 'Blue Tokai Coffee Roasters', 'city': 'Bangalore', 'sub_zone': 'Domlur', 'platform': 'zomato', 'res_id': 20661130, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568851, 'download_latency': 0.7360022068023682, 'depth': 0} 2025-03-10 01:08:30 [reviews] INFO: Stopping for res_id: 20661130 as reviews are older than 7 days. 2025-03-10 01:08:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:08:34 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568854, 'download_latency': 0.7310667037963867, 'depth': 0} 2025-03-10 01:08:34 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283673186, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565} 2025-03-10 01:08:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20667565&page=1> {'review': '', 'review_id': 283673186, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565} 2025-03-10 01:08:34 [reviews] INFO: Scraped item: {'review': 'It was a very smooth experience. The valet parking at Yazu is a lifesaver in busy Lower Parel. The food and drinks were as excellent as the service. Loved the ambiance and prompt attention from the staff.', 'review_id': 283672589, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565} 2025-03-10 01:08:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20667565&page=1> {'review': 'It was a very smooth experience. The valet parking at Yazu is a lifesaver in busy Lower Parel. The food and drinks were as excellent as the service. Loved the ambiance and prompt attention from the staff.', 'review_id': 283672589, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565} 2025-03-10 01:08:34 [reviews] INFO: Scraped item: {'review': "I must say Yazu is an ideal date night spot in Andheri. Also, it's an gastronomic delight for Asian food lovers. Me and my girlfriend loved the dimsum and Baos. Also, the drinks are well made.", 'review_id': 283659519, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565} 2025-03-10 01:08:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20667565&page=1> {'review': "I must say Yazu is an ideal date night spot in Andheri. Also, it's an gastronomic delight for Asian food lovers. Me and my girlfriend loved the dimsum and Baos. Also, the drinks are well made.", 'review_id': 283659519, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565} 2025-03-10 01:08:34 [reviews] INFO: Scraped item: {'review': 'Yazu is a paradise for Asian cuisine enthusiasts. The Prawn Xo Dumplings and Lamb in Black Pepper Sauce were bursting with flavors. The cocktails and music enhanced the overall experience.', 'review_id': 283649628, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565} 2025-03-10 01:08:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20667565&page=1> {'review': 'Yazu is a paradise for Asian cuisine enthusiasts. The Prawn Xo Dumplings and Lamb in Black Pepper Sauce were bursting with flavors. The cocktails and music enhanced the overall experience.', 'review_id': 283649628, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565} 2025-03-10 01:08:34 [reviews] INFO: Scraped item: {'review': 'Tried their home delivery, and the food arrived hot and fresh. The Baby Potatoes with Honey Chilli Sauce and Non-Veg Hakka Noodles were delicious. Great for a cozy night in.', 'review_id': 282609911, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-04', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565} 2025-03-10 01:08:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20667565&page=1> {'review': 'Tried their home delivery, and the food arrived hot and fresh. The Baby Potatoes with Honey Chilli Sauce and Non-Veg Hakka Noodles were delicious. Great for a cozy night in.', 'review_id': 282609911, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-04', 'competitor_id': 41, 'brand_name': 'YAZU - Pan Asian Supper Club', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20667565} 2025-03-10 01:08:38 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:08:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:08:44 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:08:48 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:08:52 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:08:56 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:09:00 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:09:03 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:09:05 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:09:06 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 5 pages/min), scraped 548 items (at 13 items/min) 2025-03-10 01:09:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:09:10 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 47, 'brand_name': 'ASIE', 'city': 'Hyderabad', 'sub_zone': 'Gachibowli', 'platform': 'zomato', 'res_id': 20682991, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568890, 'download_latency': 0.7594258785247803, 'depth': 0} 2025-03-10 01:09:10 [reviews] INFO: Scraped item: {'review': 'ARROGANCE, ATTITUDE, APATHETIC, ARGUMENTATIVE, ABRASIVE. Dirtiest staff I have ever seen in any restaurant. Even illiterate people know how to behave with other people, these guys are worse than illiterate people. will SHUTDOWN FOR SURE.', 'review_id': 284096556, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 47, 'brand_name': 'ASIE', 'city': 'Hyderabad', 'sub_zone': 'Gachibowli', 'platform': 'zomato', 'res_id': 20682991} 2025-03-10 01:09:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20682991&page=1> {'review': 'ARROGANCE, ATTITUDE, APATHETIC, ARGUMENTATIVE, ABRASIVE. Dirtiest staff I have ever seen in any restaurant. Even illiterate people know how to behave with other people, these guys are worse than illiterate people. will SHUTDOWN FOR SURE.', 'review_id': 284096556, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 47, 'brand_name': 'ASIE', 'city': 'Hyderabad', 'sub_zone': 'Gachibowli', 'platform': 'zomato', 'res_id': 20682991} 2025-03-10 01:09:10 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283835771, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 47, 'brand_name': 'ASIE', 'city': 'Hyderabad', 'sub_zone': 'Gachibowli', 'platform': 'zomato', 'res_id': 20682991} 2025-03-10 01:09:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20682991&page=1> {'review': '', 'review_id': 283835771, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 47, 'brand_name': 'ASIE', 'city': 'Hyderabad', 'sub_zone': 'Gachibowli', 'platform': 'zomato', 'res_id': 20682991} 2025-03-10 01:09:10 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283492383, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 47, 'brand_name': 'ASIE', 'city': 'Hyderabad', 'sub_zone': 'Gachibowli', 'platform': 'zomato', 'res_id': 20682991} 2025-03-10 01:09:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20682991&page=1> {'review': '', 'review_id': 283492383, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 47, 'brand_name': 'ASIE', 'city': 'Hyderabad', 'sub_zone': 'Gachibowli', 'platform': 'zomato', 'res_id': 20682991} 2025-03-10 01:09:10 [reviews] INFO: Scraped item: {'review': '', 'review_id': 282821294, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 47, 'brand_name': 'ASIE', 'city': 'Hyderabad', 'sub_zone': 'Gachibowli', 'platform': 'zomato', 'res_id': 20682991} 2025-03-10 01:09:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20682991&page=1> {'review': '', 'review_id': 282821294, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 47, 'brand_name': 'ASIE', 'city': 'Hyderabad', 'sub_zone': 'Gachibowli', 'platform': 'zomato', 'res_id': 20682991} 2025-03-10 01:09:10 [reviews] INFO: Scraped item: {'review': 'This place offers the best asian food in Hyderabad. Loved the dimsums and starters. They were damn good', 'review_id': 282626210, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 47, 'brand_name': 'ASIE', 'city': 'Hyderabad', 'sub_zone': 'Gachibowli', 'platform': 'zomato', 'res_id': 20682991} 2025-03-10 01:09:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20682991&page=1> {'review': 'This place offers the best asian food in Hyderabad. Loved the dimsums and starters. They were damn good', 'review_id': 282626210, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 47, 'brand_name': 'ASIE', 'city': 'Hyderabad', 'sub_zone': 'Gachibowli', 'platform': 'zomato', 'res_id': 20682991} 2025-03-10 01:09:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:09:13 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 3, 'brand_name': 'JuCo Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 20789516, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568895, 'download_latency': 0.7512829303741455, 'depth': 0} 2025-03-10 01:09:13 [reviews] INFO: Scraped item: {'review': 'it was so dry and no where close to falafel. the wrap had cucumber and hardly any pieces of falafel. it was so brittle ', 'review_id': 284290707, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 3, 'brand_name': 'JuCo Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 20789516} 2025-03-10 01:09:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20789516&page=1> {'review': 'it was so dry and no where close to falafel. the wrap had cucumber and hardly any pieces of falafel. it was so brittle ', 'review_id': 284290707, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 3, 'brand_name': 'JuCo Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 20789516} 2025-03-10 01:09:13 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283664021, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 3, 'brand_name': 'JuCo Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 20789516} 2025-03-10 01:09:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20789516&page=1> {'review': '', 'review_id': 283664021, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 3, 'brand_name': 'JuCo Cafe', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 20789516} 2025-03-10 01:09:13 [reviews] INFO: Stopping for res_id: 20789516 as reviews are older than 7 days. 2025-03-10 01:09:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:09:17 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Ahmedabad ', 'sub_zone': 'Palladium Mall', 'platform': 'zomato', 'res_id': 20816697, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568899, 'download_latency': 1.5833323001861572, 'depth': 0} 2025-03-10 01:09:17 [reviews] INFO: Scraped item: {'review': 'good food.', 'review_id': 284526997, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Ahmedabad ', 'sub_zone': 'Palladium Mall', 'platform': 'zomato', 'res_id': 20816697} 2025-03-10 01:09:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20816697&page=1> {'review': 'good food.', 'review_id': 284526997, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Ahmedabad ', 'sub_zone': 'Palladium Mall', 'platform': 'zomato', 'res_id': 20816697} 2025-03-10 01:09:17 [reviews] INFO: Scraped item: {'review': 'every dish smelled like fish', 'review_id': 283627400, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Ahmedabad ', 'sub_zone': 'Palladium Mall', 'platform': 'zomato', 'res_id': 20816697} 2025-03-10 01:09:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20816697&page=1> {'review': 'every dish smelled like fish', 'review_id': 283627400, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 10, 'brand_name': 'Foo', 'city': 'Ahmedabad ', 'sub_zone': 'Palladium Mall', 'platform': 'zomato', 'res_id': 20816697} 2025-03-10 01:09:17 [reviews] INFO: Stopping for res_id: 20816697 as reviews are older than 7 days. 2025-03-10 01:09:20 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:09:24 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:09:28 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:09:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:09:33 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20828825, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568914, 'download_latency': 0.7821433544158936, 'depth': 0} 2025-03-10 01:09:33 [reviews] INFO: Scraped item: {'review': 'The pasta was good, a bit spicy. What disappointed was there was no cutlery sent even after a specific request. Please send it when requested, as we dont carry it with us always..
', 'review_id': 284131550, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20828825} 2025-03-10 01:09:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20828825&page=1> {'review': 'The pasta was good, a bit spicy. What disappointed was there was no cutlery sent even after a specific request. Please send it when requested, as we dont carry it with us always..
', 'review_id': 284131550, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 2, 'brand_name': 'The Dough Therapy', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 20828825} 2025-03-10 01:09:33 [reviews] INFO: Stopping for res_id: 20828825 as reviews are older than 7 days. 2025-03-10 01:09:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:09:38 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:09:43 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:09:47 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:09:51 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:09:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:09:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:09:59 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568940, 'download_latency': 0.71956467628479, 'depth': 0} 2025-03-10 01:09:59 [reviews] INFO: Scraped item: {'review': 'great taste and good quantity', 'review_id': 284511334, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186} 2025-03-10 01:09:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20844186&page=1> {'review': 'great taste and good quantity', 'review_id': 284511334, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186} 2025-03-10 01:09:59 [reviews] INFO: Scraped item: {'review': 'Love the food any service of Balram Yadav', 'review_id': 284490907, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186} 2025-03-10 01:09:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20844186&page=1> {'review': 'Love the food any service of Balram Yadav', 'review_id': 284490907, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186} 2025-03-10 01:09:59 [reviews] INFO: Scraped item: {'review': 'food is good but quantity is very very less compared to earlier orders please focus on this', 'review_id': 284346158, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186} 2025-03-10 01:09:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20844186&page=1> {'review': 'food is good but quantity is very very less compared to earlier orders please focus on this', 'review_id': 284346158, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186} 2025-03-10 01:09:59 [reviews] INFO: Scraped item: {'review': 'need more staff for service ', 'review_id': 284123747, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186} 2025-03-10 01:09:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20844186&page=1> {'review': 'need more staff for service ', 'review_id': 284123747, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186} 2025-03-10 01:09:59 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283934232, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186} 2025-03-10 01:09:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20844186&page=1> {'review': '', 'review_id': 283934232, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Kailash Colony', 'platform': 'zomato', 'res_id': 20844186} 2025-03-10 01:10:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:10:02 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568943, 'download_latency': 0.8098211288452148, 'depth': 0} 2025-03-10 01:10:02 [reviews] INFO: Scraped item: {'review': 'Extra chilli added for no tatse', 'review_id': 284182800, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681} 2025-03-10 01:10:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20880681&page=1> {'review': 'Extra chilli added for no tatse', 'review_id': 284182800, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681} 2025-03-10 01:10:02 [reviews] INFO: Scraped item: {'review': 'Received chicken at place of paneer', 'review_id': 284050356, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681} 2025-03-10 01:10:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20880681&page=1> {'review': 'Received chicken at place of paneer', 'review_id': 284050356, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681} 2025-03-10 01:10:02 [reviews] INFO: Scraped item: {'review': 'old food, not fresh, this outlet near shalimar bagh is not good. sa', 'review_id': 283941788, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681} 2025-03-10 01:10:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20880681&page=1> {'review': 'old food, not fresh, this outlet near shalimar bagh is not good. sa', 'review_id': 283941788, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681} 2025-03-10 01:10:02 [reviews] INFO: Scraped item: {'review': "I've had a great experience every time I have ordered from here. I have suggested it to some of my friends too.
Please mark salan and raita.", 'review_id': 283360479, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681} 2025-03-10 01:10:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20880681&page=1> {'review': "I've had a great experience every time I have ordered from here. I have suggested it to some of my friends too.
Please mark salan and raita.", 'review_id': 283360479, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681} 2025-03-10 01:10:02 [reviews] INFO: Scraped item: {'review': "i think u don't know what south indian parota.. This is not a parota. this is like chappathi.... worst taste... i just want my money back.. plz return it... ", 'review_id': 283244099, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681} 2025-03-10 01:10:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20880681&page=1> {'review': "i think u don't know what south indian parota.. This is not a parota. this is like chappathi.... worst taste... i just want my money back.. plz return it... ", 'review_id': 283244099, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 20, 'brand_name': 'Thalairaj Biryani', 'city': 'New Delhi', 'sub_zone': 'Rohini', 'platform': 'zomato', 'res_id': 20880681} 2025-03-10 01:10:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:10:05 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 3, 'brand_name': 'Achija', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 20895131, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568946, 'download_latency': 0.7796063423156738, 'depth': 0} 2025-03-10 01:10:05 [reviews] INFO: Scraped item: {'review': 'Too oily', 'review_id': 284478981, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 3, 'brand_name': 'Achija', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 20895131} 2025-03-10 01:10:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20895131&page=1> {'review': 'Too oily', 'review_id': 284478981, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 3, 'brand_name': 'Achija', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 20895131} 2025-03-10 01:10:05 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284120367, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 3, 'brand_name': 'Achija', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 20895131} 2025-03-10 01:10:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20895131&page=1> {'review': '', 'review_id': 284120367, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 3, 'brand_name': 'Achija', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 20895131} 2025-03-10 01:10:05 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284075546, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 3, 'brand_name': 'Achija', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 20895131} 2025-03-10 01:10:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20895131&page=1> {'review': '', 'review_id': 284075546, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 3, 'brand_name': 'Achija', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 20895131} 2025-03-10 01:10:05 [reviews] INFO: Scraped item: {'review': 'I HAD SPECIFICALLY TOLD TO MAKE NON SPICY!!!!! MANCHURIAN IS EXTREMELY SPICYY???', 'review_id': 283347320, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 3, 'brand_name': 'Achija', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 20895131} 2025-03-10 01:10:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20895131&page=1> {'review': 'I HAD SPECIFICALLY TOLD TO MAKE NON SPICY!!!!! MANCHURIAN IS EXTREMELY SPICYY???', 'review_id': 283347320, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 3, 'brand_name': 'Achija', 'city': 'Mumbai', 'sub_zone': 'NA', 'platform': 'zomato', 'res_id': 20895131} 2025-03-10 01:10:05 [reviews] INFO: Stopping for res_id: 20895131 as reviews are older than 7 days. 2025-03-10 01:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-10 01:10:06 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-10 01:10:06 [scrapy.extensions.logstats] INFO: Crawled 169 pages (at 7 pages/min), scraped 572 items (at 24 items/min) 2025-03-10 01:10:08 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:10:09 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568950, 'download_latency': 0.7505841255187988, 'depth': 0} 2025-03-10 01:10:09 [reviews] INFO: Scraped item: {'review': 'excellent food with quite amazing staff and ambience also sugestions from Satyanand were amazing', 'review_id': 283425583, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097} 2025-03-10 01:10:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20896097&page=1> {'review': 'excellent food with quite amazing staff and ambience also sugestions from Satyanand were amazing', 'review_id': 283425583, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097} 2025-03-10 01:10:09 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283189819, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097} 2025-03-10 01:10:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20896097&page=1> {'review': '', 'review_id': 283189819, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097} 2025-03-10 01:10:09 [reviews] INFO: Scraped item: {'review': 'Delhi papdi chaat did not have Bhalla and sweet chutney', 'review_id': 283105396, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097} 2025-03-10 01:10:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20896097&page=1> {'review': 'Delhi papdi chaat did not have Bhalla and sweet chutney', 'review_id': 283105396, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097} 2025-03-10 01:10:09 [reviews] INFO: Scraped item: {'review': 'Nostalgia', 'review_id': 282616690, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097} 2025-03-10 01:10:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20896097&page=1> {'review': 'Nostalgia', 'review_id': 282616690, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 23, 'brand_name': 'Cream Centre', 'city': 'Mumbai', 'sub_zone': 'THANE', 'platform': 'zomato', 'res_id': 20896097} 2025-03-10 01:10:09 [reviews] INFO: Stopping for res_id: 20896097 as reviews are older than 7 days. 2025-03-10 01:10:10 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:10:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:10:14 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568957, 'download_latency': 0.7489254474639893, 'depth': 0} 2025-03-10 01:10:14 [reviews] INFO: Scraped item: {'review': 'Taste good but turmeric was too much in filing
', 'review_id': 283929131, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523} 2025-03-10 01:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20907523&page=1> {'review': 'Taste good but turmeric was too much in filing
', 'review_id': 283929131, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523} 2025-03-10 01:10:14 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283549454, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523} 2025-03-10 01:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20907523&page=1> {'review': '', 'review_id': 283549454, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523} 2025-03-10 01:10:14 [reviews] INFO: Scraped item: {'review': 'excessively oily food, tasteless, the khichdi hardly had any rice in it', 'review_id': 283241946, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523} 2025-03-10 01:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20907523&page=1> {'review': 'excessively oily food, tasteless, the khichdi hardly had any rice in it', 'review_id': 283241946, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523} 2025-03-10 01:10:14 [reviews] INFO: Scraped item: {'review': 'little late ', 'review_id': 283240022, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523} 2025-03-10 01:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20907523&page=1> {'review': 'little late ', 'review_id': 283240022, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523} 2025-03-10 01:10:14 [reviews] INFO: Scraped item: {'review': 'Amazing taste, quality and packaging.', 'review_id': 283043413, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523} 2025-03-10 01:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20907523&page=1> {'review': 'Amazing taste, quality and packaging.', 'review_id': 283043413, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 4, 'brand_name': 'Bhagat Tarachand', 'city': 'Mumbai', 'sub_zone': 'LowerParel', 'platform': 'zomato', 'res_id': 20907523} 2025-03-10 01:10:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:10:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:10:26 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:10:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:10:30 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741568973, 'download_latency': 0.7331221103668213, 'depth': 0} 2025-03-10 01:10:30 [reviews] INFO: Scraped item: {'review': 'there is a slight change in mapo tofu I had last time but it was good ', 'review_id': 284345749, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125} 2025-03-10 01:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20998125&page=1> {'review': 'there is a slight change in mapo tofu I had last time but it was good ', 'review_id': 284345749, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125} 2025-03-10 01:10:30 [reviews] INFO: Scraped item: {'review': 'Mr. Anil was really helpful and kind. Wonderful service.', 'review_id': 284095392, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125} 2025-03-10 01:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20998125&page=1> {'review': 'Mr. Anil was really helpful and kind. Wonderful service.', 'review_id': 284095392, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125} 2025-03-10 01:10:30 [reviews] INFO: Scraped item: {'review': 'Amazing staff, Anil Vishwakarma gave an good experience and amazing food', 'review_id': 284078549, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125} 2025-03-10 01:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20998125&page=1> {'review': 'Amazing staff, Anil Vishwakarma gave an good experience and amazing food', 'review_id': 284078549, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125} 2025-03-10 01:10:30 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283000884, 'rating': '3', 'review_type': 'DINING', 'review_date': '2025-03-06', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125} 2025-03-10 01:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20998125&page=1> {'review': '', 'review_id': 283000884, 'rating': '3', 'review_type': 'DINING', 'review_date': '2025-03-06', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125} 2025-03-10 01:10:30 [reviews] INFO: Scraped item: {'review': '', 'review_id': 282665204, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125} 2025-03-10 01:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=20998125&page=1> {'review': '', 'review_id': 282665204, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 42, 'brand_name': 'You Mee', 'city': 'Mumbai ', 'sub_zone': 'Andheri West', 'platform': 'zomato', 'res_id': 20998125} 2025-03-10 01:10:34 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:10:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:10:39 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:10:43 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:10:47 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:10:51 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:10:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:10:54 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 48, 'brand_name': 'Sakura - A Far Eastern Kitchen', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 21012857, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741569000, 'download_latency': 0.7447316646575928, 'depth': 0} 2025-03-10 01:10:54 [reviews] INFO: Scraped item: {'review': 'Sumptuous food and fast service', 'review_id': 284069857, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 48, 'brand_name': 'Sakura - A Far Eastern Kitchen', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 21012857} 2025-03-10 01:10:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21012857&page=1> {'review': 'Sumptuous food and fast service', 'review_id': 284069857, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 48, 'brand_name': 'Sakura - A Far Eastern Kitchen', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 21012857} 2025-03-10 01:10:54 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283759785, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 48, 'brand_name': 'Sakura - A Far Eastern Kitchen', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 21012857} 2025-03-10 01:10:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21012857&page=1> {'review': '', 'review_id': 283759785, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-08', 'competitor_id': 48, 'brand_name': 'Sakura - A Far Eastern Kitchen', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 21012857} 2025-03-10 01:10:54 [reviews] INFO: Scraped item: {'review': 'The ambience was very Unique. The food was served hot and tasted very good. The hot stone noodles, Miso chicken ramen, chicken karage, Golden fried prawns were our favourites. The server Mr Srikanth was excellent. He was very prompt in his service and made sure to check on us if we needed anything. ', 'review_id': 283324576, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 48, 'brand_name': 'Sakura - A Far Eastern Kitchen', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 21012857} 2025-03-10 01:10:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21012857&page=1> {'review': 'The ambience was very Unique. The food was served hot and tasted very good. The hot stone noodles, Miso chicken ramen, chicken karage, Golden fried prawns were our favourites. The server Mr Srikanth was excellent. He was very prompt in his service and made sure to check on us if we needed anything. ', 'review_id': 283324576, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 48, 'brand_name': 'Sakura - A Far Eastern Kitchen', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 21012857} 2025-03-10 01:10:54 [reviews] INFO: Scraped item: {'review': 'Food and service is good
Definitely a yes for family dinners', 'review_id': 283056271, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-06', 'competitor_id': 48, 'brand_name': 'Sakura - A Far Eastern Kitchen', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 21012857} 2025-03-10 01:10:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21012857&page=1> {'review': 'Food and service is good
Definitely a yes for family dinners', 'review_id': 283056271, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-06', 'competitor_id': 48, 'brand_name': 'Sakura - A Far Eastern Kitchen', 'city': 'Hyderabad', 'sub_zone': 'Jubilee Hills', 'platform': 'zomato', 'res_id': 21012857} 2025-03-10 01:10:54 [reviews] INFO: Stopping for res_id: 21012857 as reviews are older than 7 days. 2025-03-10 01:10:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:11:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:11:06 [scrapy.extensions.logstats] INFO: Crawled 173 pages (at 4 pages/min), scraped 590 items (at 18 items/min) 2025-03-10 01:11:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:11:06 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 29, 'brand_name': 'abCoffee', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21031542, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741569009, 'download_latency': 0.9132261276245117, 'depth': 0} 2025-03-10 01:11:06 [reviews] INFO: Scraped item: {'review': 'Ordered cold coffee, got lukewarm instead', 'review_id': 282622674, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 29, 'brand_name': 'abCoffee', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21031542} 2025-03-10 01:11:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21031542&page=1> {'review': 'Ordered cold coffee, got lukewarm instead', 'review_id': 282622674, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 29, 'brand_name': 'abCoffee', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21031542} 2025-03-10 01:11:06 [reviews] INFO: Stopping for res_id: 21031542 as reviews are older than 7 days. 2025-03-10 01:11:09 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:11:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:11:14 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 3', 'platform': 'zomato', 'res_id': 21061214, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741569015, 'download_latency': 0.7284305095672607, 'depth': 0} 2025-03-10 01:11:14 [reviews] INFO: Scraped item: {'review': 'biryani rice was quite hard ', 'review_id': 283869251, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 3', 'platform': 'zomato', 'res_id': 21061214} 2025-03-10 01:11:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21061214&page=1> {'review': 'biryani rice was quite hard ', 'review_id': 283869251, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 3', 'platform': 'zomato', 'res_id': 21061214} 2025-03-10 01:11:14 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283705634, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 3', 'platform': 'zomato', 'res_id': 21061214} 2025-03-10 01:11:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21061214&page=1> {'review': '', 'review_id': 283705634, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 3', 'platform': 'zomato', 'res_id': 21061214} 2025-03-10 01:11:14 [reviews] INFO: Scraped item: {'review': 'No cutlery send and only one mutton small pic so badly experience', 'review_id': 283396547, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 3', 'platform': 'zomato', 'res_id': 21061214} 2025-03-10 01:11:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21061214&page=1> {'review': 'No cutlery send and only one mutton small pic so badly experience', 'review_id': 283396547, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 3', 'platform': 'zomato', 'res_id': 21061214} 2025-03-10 01:11:14 [reviews] INFO: Scraped item: {'review': "Restaurant didn't provide cutlery which they have an option to add also in their menu. Also the taste is not upto mark.", 'review_id': 282520888, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 3', 'platform': 'zomato', 'res_id': 21061214} 2025-03-10 01:11:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21061214&page=1> {'review': "Restaurant didn't provide cutlery which they have an option to add also in their menu. Also the taste is not upto mark.", 'review_id': 282520888, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Gurgaon', 'sub_zone': 'DLF Phase 3', 'platform': 'zomato', 'res_id': 21061214} 2025-03-10 01:11:14 [reviews] INFO: Stopping for res_id: 21061214 as reviews are older than 7 days. 2025-03-10 01:11:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:11:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:11:26 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:11:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:11:31 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 29, 'brand_name': 'abCoffee', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 21091083, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741569031, 'download_latency': 1.8186931610107422, 'depth': 0} 2025-03-10 01:11:31 [reviews] INFO: Scraped item: {'review': 'Espresso not packed well..it has burst from the bottom ', 'review_id': 283833480, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 29, 'brand_name': 'abCoffee', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 21091083} 2025-03-10 01:11:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21091083&page=1> {'review': 'Espresso not packed well..it has burst from the bottom ', 'review_id': 283833480, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 29, 'brand_name': 'abCoffee', 'city': 'Mumbai', 'sub_zone': 'Lower Parel', 'platform': 'zomato', 'res_id': 21091083} 2025-03-10 01:11:31 [reviews] INFO: Stopping for res_id: 21091083 as reviews are older than 7 days. 2025-03-10 01:11:33 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:11:35 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:11:39 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:11:42 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:11:45 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:11:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:11:51 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741569052, 'download_latency': 1.2165491580963135, 'depth': 0} 2025-03-10 01:11:51 [reviews] INFO: Scraped item: {'review': 'Chicken dry roast : very few pieces ( 4 ). Coating of flour is more and uneven. Not worth the high price. Pathetic. Biryani : Too much of Masala . Not at all good. Overall not worth it.', 'review_id': 284317870, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421} 2025-03-10 01:11:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21131421&page=1> {'review': 'Chicken dry roast : very few pieces ( 4 ). Coating of flour is more and uneven. Not worth the high price. Pathetic. Biryani : Too much of Masala . Not at all good. Overall not worth it.', 'review_id': 284317870, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421} 2025-03-10 01:11:51 [reviews] INFO: Scraped item: {'review': 'west of money, bakvas test and all ', 'review_id': 283773806, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421} 2025-03-10 01:11:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21131421&page=1> {'review': 'west of money, bakvas test and all ', 'review_id': 283773806, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421} 2025-03-10 01:11:51 [reviews] INFO: Scraped item: {'review': 'This time there was more of that masala mix than usual biriyani rice. The taste was good but need to reduce the quantity of masala mix and increase the rice proportionally.', 'review_id': 283680253, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421} 2025-03-10 01:11:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21131421&page=1> {'review': 'This time there was more of that masala mix than usual biriyani rice. The taste was good but need to reduce the quantity of masala mix and increase the rice proportionally.', 'review_id': 283680253, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421} 2025-03-10 01:11:51 [reviews] INFO: Scraped item: {'review': 'the food is soo delicious and all the biryani taste soooo good .100% recommend ', 'review_id': 283328743, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421} 2025-03-10 01:11:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21131421&page=1> {'review': 'the food is soo delicious and all the biryani taste soooo good .100% recommend ', 'review_id': 283328743, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421} 2025-03-10 01:11:51 [reviews] INFO: Scraped item: {'review': 'It was a great feast. Used to order it in Delhi. The location has changed but the taste is the same. 5*', 'review_id': 283074353, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421} 2025-03-10 01:11:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21131421&page=1> {'review': 'It was a great feast. Used to order it in Delhi. The location has changed but the taste is the same. 5*', 'review_id': 283074353, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21131421} 2025-03-10 01:11:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:11:54 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Khar', 'platform': 'zomato', 'res_id': 21144195, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741569055, 'download_latency': 0.8716409206390381, 'depth': 0} 2025-03-10 01:11:54 [reviews] INFO: Scraped item: {'review': 'superb food', 'review_id': 282601529, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-04', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Khar', 'platform': 'zomato', 'res_id': 21144195} 2025-03-10 01:11:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21144195&page=1> {'review': 'superb food', 'review_id': 282601529, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-04', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Khar', 'platform': 'zomato', 'res_id': 21144195} 2025-03-10 01:11:54 [reviews] INFO: Scraped item: {'review': 'superb taste', 'review_id': 282599457, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-04', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Khar', 'platform': 'zomato', 'res_id': 21144195} 2025-03-10 01:11:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21144195&page=1> {'review': 'superb taste', 'review_id': 282599457, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-04', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Mumbai', 'sub_zone': 'Khar', 'platform': 'zomato', 'res_id': 21144195} 2025-03-10 01:11:54 [reviews] INFO: Stopping for res_id: 21144195 as reviews are older than 7 days. 2025-03-10 01:11:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:12:01 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:12:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:12:06 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 21146712, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741569067, 'download_latency': 0.9562878608703613, 'depth': 0} 2025-03-10 01:12:06 [reviews] INFO: Scraped item: {'review': "I generally like biryani here... but today's didn't like freshly made. rice is over cooked and chicken is more than rice. This time I'm not satisfied.", 'review_id': 284519586, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 21146712} 2025-03-10 01:12:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21146712&page=1> {'review': "I generally like biryani here... but today's didn't like freshly made. rice is over cooked and chicken is more than rice. This time I'm not satisfied.", 'review_id': 284519586, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 21146712} 2025-03-10 01:12:06 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284338462, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 21146712} 2025-03-10 01:12:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21146712&page=1> {'review': '', 'review_id': 284338462, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 21146712} 2025-03-10 01:12:06 [reviews] INFO: Scraped item: {'review': 'taste was good but was little bit salty ', 'review_id': 282576035, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 21146712} 2025-03-10 01:12:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21146712&page=1> {'review': 'taste was good but was little bit salty ', 'review_id': 282576035, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 21146712} 2025-03-10 01:12:06 [reviews] INFO: Scraped item: {'review': 'extremely dry bad in test ', 'review_id': 282413035, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 21146712} 2025-03-10 01:12:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21146712&page=1> {'review': 'extremely dry bad in test ', 'review_id': 282413035, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Chembur', 'platform': 'zomato', 'res_id': 21146712} 2025-03-10 01:12:06 [reviews] INFO: Stopping for res_id: 21146712 as reviews are older than 7 days. 2025-03-10 01:12:06 [scrapy.extensions.logstats] INFO: Crawled 179 pages (at 6 pages/min), scraped 607 items (at 17 items/min) 2025-03-10 01:12:09 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:12:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:12:15 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741569075, 'download_latency': 1.592226505279541, 'depth': 0} 2025-03-10 01:12:15 [reviews] INFO: Scraped item: {'review': 'excellent packaging and good food quality ', 'review_id': 283854683, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450} 2025-03-10 01:12:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21227450&page=1> {'review': 'excellent packaging and good food quality ', 'review_id': 283854683, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450} 2025-03-10 01:12:15 [reviews] INFO: Scraped item: {'review': 'The mutton was undercooked.', 'review_id': 283527130, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450} 2025-03-10 01:12:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21227450&page=1> {'review': 'The mutton was undercooked.', 'review_id': 283527130, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450} 2025-03-10 01:12:15 [reviews] INFO: Scraped item: {'review': ' rice is awesome ๐Ÿฅฐ๐Ÿฅฐ๐Ÿฅฐ๐Ÿฅฐ๐Ÿฅฐ', 'review_id': 282908194, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450} 2025-03-10 01:12:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21227450&page=1> {'review': ' rice is awesome ๐Ÿฅฐ๐Ÿฅฐ๐Ÿฅฐ๐Ÿฅฐ๐Ÿฅฐ', 'review_id': 282908194, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450} 2025-03-10 01:12:15 [reviews] INFO: Scraped item: {'review': 'Overall biryani was awesome , taste and ingredients was fully loaded just that i think rice should have been of quite better quality, 4/5 . 1 marks short for rice', 'review_id': 282806887, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450} 2025-03-10 01:12:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21227450&page=1> {'review': 'Overall biryani was awesome , taste and ingredients was fully loaded just that i think rice should have been of quite better quality, 4/5 . 1 marks short for rice', 'review_id': 282806887, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450} 2025-03-10 01:12:15 [reviews] INFO: Scraped item: {'review': 'Too. Much spicy', 'review_id': 282786124, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450} 2025-03-10 01:12:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21227450&page=1> {'review': 'Too. Much spicy', 'review_id': 282786124, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-05', 'competitor_id': 18, 'brand_name': 'Bikkgane Biryani', 'city': 'Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21227450} 2025-03-10 01:12:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:12:19 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:12:23 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:12:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:12:28 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 21240266, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741569091, 'download_latency': 0.923602819442749, 'depth': 0} 2025-03-10 01:12:28 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284494941, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 21240266} 2025-03-10 01:12:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21240266&page=1> {'review': '', 'review_id': 284494941, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 21240266} 2025-03-10 01:12:28 [reviews] INFO: Scraped item: {'review': 'The chicken was raw', 'review_id': 284439958, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 21240266} 2025-03-10 01:12:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21240266&page=1> {'review': 'The chicken was raw', 'review_id': 284439958, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 21240266} 2025-03-10 01:12:28 [reviews] INFO: Scraped item: {'review': "It wasn't a biryani... just rice and chicken and that too chicken is under cooked ", 'review_id': 283738931, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 21240266} 2025-03-10 01:12:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21240266&page=1> {'review': "It wasn't a biryani... just rice and chicken and that too chicken is under cooked ", 'review_id': 283738931, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 21240266} 2025-03-10 01:12:28 [reviews] INFO: Scraped item: {'review': 'too less masala. important part is missing', 'review_id': 283001589, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 21240266} 2025-03-10 01:12:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21240266&page=1> {'review': 'too less masala. important part is missing', 'review_id': 283001589, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'New Delhi', 'sub_zone': 'Vasant Kunj', 'platform': 'zomato', 'res_id': 21240266} 2025-03-10 01:12:28 [reviews] INFO: Stopping for res_id: 21240266 as reviews are older than 7 days. 2025-03-10 01:12:30 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:12:33 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:12:38 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:12:41 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:12:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:12:46 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741569106, 'download_latency': 0.9294004440307617, 'depth': 0} 2025-03-10 01:12:46 [reviews] INFO: Scraped item: {'review': 'Can improve the dish', 'review_id': 284383524, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546} 2025-03-10 01:12:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21264546&page=1> {'review': 'Can improve the dish', 'review_id': 284383524, 'rating': '4', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546} 2025-03-10 01:12:46 [reviews] INFO: Scraped item: {'review': 'Angoori Rabri very poor taste', 'review_id': 284280896, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546} 2025-03-10 01:12:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21264546&page=1> {'review': 'Angoori Rabri very poor taste', 'review_id': 284280896, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546} 2025-03-10 01:12:46 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283303429, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546} 2025-03-10 01:12:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21264546&page=1> {'review': '', 'review_id': 283303429, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546} 2025-03-10 01:12:46 [reviews] INFO: Scraped item: {'review': 'The cheese chilli samosa is not cooked properly , it was raw and led to severe stomach ache', 'review_id': 283037440, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546} 2025-03-10 01:12:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21264546&page=1> {'review': 'The cheese chilli samosa is not cooked properly , it was raw and led to severe stomach ache', 'review_id': 283037440, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546} 2025-03-10 01:12:46 [reviews] INFO: Scraped item: {'review': 'serving without their trade mark chutney which is the main reason for my order ', 'review_id': 282998983, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546} 2025-03-10 01:12:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21264546&page=1> {'review': 'serving without their trade mark chutney which is the main reason for my order ', 'review_id': 282998983, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Borivali', 'platform': 'zomato', 'res_id': 21264546} 2025-03-10 01:12:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:12:48 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741569111, 'download_latency': 0.7022278308868408, 'depth': 0} 2025-03-10 01:12:48 [reviews] INFO: Scraped item: {'review': "The quantity was really less and also it's not the same as it is supposed to be. We've had from this place a lot many times but today was very poor quality", 'review_id': 283680541, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729} 2025-03-10 01:12:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21275729&page=1> {'review': "The quantity was really less and also it's not the same as it is supposed to be. We've had from this place a lot many times but today was very poor quality", 'review_id': 283680541, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729} 2025-03-10 01:12:48 [reviews] INFO: Scraped item: {'review': 'EXCELLENT TASTE', 'review_id': 283397289, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729} 2025-03-10 01:12:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21275729&page=1> {'review': 'EXCELLENT TASTE', 'review_id': 283397289, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729} 2025-03-10 01:12:48 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283342278, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729} 2025-03-10 01:12:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21275729&page=1> {'review': '', 'review_id': 283342278, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729} 2025-03-10 01:12:48 [reviews] INFO: Scraped item: {'review': "the kachori was very soggy. it felt like I was eating a stuffed puri.
the jalebis were crunchy but there was sourness in its taste and it wasn't sweet enough.
I expected a better experience for the price that I paid", 'review_id': 283193873, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729} 2025-03-10 01:12:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21275729&page=1> {'review': "the kachori was very soggy. it felt like I was eating a stuffed puri.
the jalebis were crunchy but there was sourness in its taste and it wasn't sweet enough.
I expected a better experience for the price that I paid", 'review_id': 283193873, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 8, 'brand_name': 'Meetha', 'city': 'Mumbai', 'sub_zone': 'Bandra', 'platform': 'zomato', 'res_id': 21275729} 2025-03-10 01:12:48 [reviews] INFO: Stopping for res_id: 21275729 as reviews are older than 7 days. 2025-03-10 01:12:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:12:55 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:12:59 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:13:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:13:03 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Navi Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21330620, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741569126, 'download_latency': 0.6959013938903809, 'depth': 0} 2025-03-10 01:13:03 [reviews] INFO: Scraped item: {'review': 'very good food ๐Ÿ˜‹', 'review_id': 282946474, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-05', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Navi Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21330620} 2025-03-10 01:13:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21330620&page=1> {'review': 'very good food ๐Ÿ˜‹', 'review_id': 282946474, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-05', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Navi Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21330620} 2025-03-10 01:13:03 [reviews] INFO: Scraped item: {'review': 'nice ', 'review_id': 282675837, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-04', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Navi Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21330620} 2025-03-10 01:13:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21330620&page=1> {'review': 'nice ', 'review_id': 282675837, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-04', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Navi Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21330620} 2025-03-10 01:13:03 [reviews] INFO: Scraped item: {'review': 'Best sizzler in My life ๐Ÿ˜˜๐Ÿ˜˜', 'review_id': 282672143, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-04', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Navi Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21330620} 2025-03-10 01:13:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21330620&page=1> {'review': 'Best sizzler in My life ๐Ÿ˜˜๐Ÿ˜˜', 'review_id': 282672143, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-04', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Navi Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21330620} 2025-03-10 01:13:03 [reviews] INFO: Scraped item: {'review': 'Nice ๐Ÿ™‚', 'review_id': 282671297, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-04', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Navi Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21330620} 2025-03-10 01:13:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21330620&page=1> {'review': 'Nice ๐Ÿ™‚', 'review_id': 282671297, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-04', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Navi Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21330620} 2025-03-10 01:13:03 [reviews] INFO: Scraped item: {'review': 'Best Chinese Thali ,,,๐Ÿ˜‰', 'review_id': 282669375, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-04', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Navi Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21330620} 2025-03-10 01:13:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21330620&page=1> {'review': 'Best Chinese Thali ,,,๐Ÿ˜‰', 'review_id': 282669375, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-04', 'competitor_id': 59, 'brand_name': 'WOW! China', 'city': 'Navi Mumbai', 'sub_zone': 'Vashi', 'platform': 'zomato', 'res_id': 21330620} 2025-03-10 01:13:05 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:13:06 [scrapy.extensions.logstats] INFO: Crawled 184 pages (at 5 pages/min), scraped 630 items (at 23 items/min) 2025-03-10 01:13:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:13:10 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21393822, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741569135, 'download_latency': 0.9563243389129639, 'depth': 0} 2025-03-10 01:13:10 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284612635, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21393822} 2025-03-10 01:13:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21393822&page=1> {'review': '', 'review_id': 284612635, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21393822} 2025-03-10 01:13:10 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284202260, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21393822} 2025-03-10 01:13:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21393822&page=1> {'review': '', 'review_id': 284202260, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21393822} 2025-03-10 01:13:10 [reviews] INFO: Scraped item: {'review': 'Must try :) great place for dessert', 'review_id': 283494220, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21393822} 2025-03-10 01:13:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21393822&page=1> {'review': 'Must try :) great place for dessert', 'review_id': 283494220, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21393822} 2025-03-10 01:13:10 [reviews] INFO: Scraped item: {'review': 'Delivery came too late. Ice cream was melted.', 'review_id': 283441543, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21393822} 2025-03-10 01:13:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21393822&page=1> {'review': 'Delivery came too late. Ice cream was melted.', 'review_id': 283441543, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21393822} 2025-03-10 01:13:10 [reviews] INFO: Scraped item: {'review': 'Best cake shop in Mumbai', 'review_id': 282664493, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21393822} 2025-03-10 01:13:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21393822&page=1> {'review': 'Best cake shop in Mumbai', 'review_id': 282664493, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-04', 'competitor_id': 30, 'brand_name': 'Magnolia Bakery', 'city': 'Mumbai', 'sub_zone': 'Worli', 'platform': 'zomato', 'res_id': 21393822} 2025-03-10 01:13:11 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:13:15 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:13:19 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:13:24 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:13:27 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:13:31 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:13:34 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:13:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:13:39 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21395028, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741569162, 'download_latency': 1.5204575061798096, 'depth': 0} 2025-03-10 01:13:39 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284305329, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21395028} 2025-03-10 01:13:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21395028&page=1> {'review': '', 'review_id': 284305329, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21395028} 2025-03-10 01:13:39 [reviews] INFO: Scraped item: {'review': 'quantity can be improved ', 'review_id': 284167551, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21395028} 2025-03-10 01:13:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21395028&page=1> {'review': 'quantity can be improved ', 'review_id': 284167551, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21395028} 2025-03-10 01:13:39 [reviews] INFO: Scraped item: {'review': 'Lovely packaging. Great food.', 'review_id': 283568254, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21395028} 2025-03-10 01:13:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21395028&page=1> {'review': 'Lovely packaging. Great food.', 'review_id': 283568254, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-07', 'competitor_id': 28, 'brand_name': 'Bombay Sweet Shop', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21395028} 2025-03-10 01:13:39 [reviews] INFO: Stopping for res_id: 21395028 as reviews are older than 7 days. 2025-03-10 01:13:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:13:43 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '4 Bungalows', 'platform': 'zomato', 'res_id': 21401321, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741569167, 'download_latency': 0.6311800479888916, 'depth': 0} 2025-03-10 01:13:43 [reviews] INFO: Scraped item: {'review': 'the rice was undercooked and stiff', 'review_id': 284629317, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '4 Bungalows', 'platform': 'zomato', 'res_id': 21401321} 2025-03-10 01:13:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21401321&page=1> {'review': 'the rice was undercooked and stiff', 'review_id': 284629317, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '4 Bungalows', 'platform': 'zomato', 'res_id': 21401321} 2025-03-10 01:13:43 [reviews] INFO: Scraped item: {'review': "Biryani's taste is not at all good. ", 'review_id': 284626158, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '4 Bungalows', 'platform': 'zomato', 'res_id': 21401321} 2025-03-10 01:13:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21401321&page=1> {'review': "Biryani's taste is not at all good. ", 'review_id': 284626158, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '4 Bungalows', 'platform': 'zomato', 'res_id': 21401321} 2025-03-10 01:13:43 [reviews] INFO: Scraped item: {'review': 'Tasteless haleem and without lime and barista , cutlet was with raw masala', 'review_id': 284621339, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '4 Bungalows', 'platform': 'zomato', 'res_id': 21401321} 2025-03-10 01:13:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21401321&page=1> {'review': 'Tasteless haleem and without lime and barista , cutlet was with raw masala', 'review_id': 284621339, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '4 Bungalows', 'platform': 'zomato', 'res_id': 21401321} 2025-03-10 01:13:43 [reviews] INFO: Scraped item: {'review': 'The biryani was very dry, not enough gravy at all.', 'review_id': 284559854, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '4 Bungalows', 'platform': 'zomato', 'res_id': 21401321} 2025-03-10 01:13:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21401321&page=1> {'review': 'The biryani was very dry, not enough gravy at all.', 'review_id': 284559854, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '4 Bungalows', 'platform': 'zomato', 'res_id': 21401321} 2025-03-10 01:13:43 [reviews] INFO: Scraped item: {'review': '', 'review_id': 284543334, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '4 Bungalows', 'platform': 'zomato', 'res_id': 21401321} 2025-03-10 01:13:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21401321&page=1> {'review': '', 'review_id': 284543334, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 1, 'brand_name': 'Persian Darbar', 'city': 'Mumbai', 'sub_zone': '4 Bungalows', 'platform': 'zomato', 'res_id': 21401321} 2025-03-10 01:13:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:13:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:13:51 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:13:55 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:14:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:14:00 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 25, 'brand_name': "Veronica's", 'city': 'Mumbai', 'sub_zone': 'Bandra East', 'platform': 'zomato', 'res_id': 21432852, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741569183, 'download_latency': 0.5395588874816895, 'depth': 0} 2025-03-10 01:14:00 [reviews] INFO: Stopping for res_id: 21432852 as reviews are older than 7 days. 2025-03-10 01:14:04 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:14:06 [scrapy.extensions.logstats] INFO: Crawled 188 pages (at 4 pages/min), scraped 643 items (at 13 items/min) 2025-03-10 01:14:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:14:12 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:14:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:14:19 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:14:23 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:14:26 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:14:30 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:14:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:14:34 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 37, 'brand_name': 'Blue Tokai Coffee Roasters', 'city': 'Bangalore', 'sub_zone': 'Lavelle Road', 'platform': 'zomato', 'res_id': 21462394, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741569215, 'download_latency': 0.6249947547912598, 'depth': 0} 2025-03-10 01:14:34 [reviews] INFO: Stopping for res_id: 21462394 as reviews are older than 7 days. 2025-03-10 01:14:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:14:39 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741569220, 'download_latency': 1.5783557891845703, 'depth': 0} 2025-03-10 01:14:39 [reviews] INFO: Scraped item: {'review': "The biryani wasn't fresh and smelled stale. I had to throw the entire food", 'review_id': 284513630, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794} 2025-03-10 01:14:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21503794&page=1> {'review': "The biryani wasn't fresh and smelled stale. I had to throw the entire food", 'review_id': 284513630, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794} 2025-03-10 01:14:39 [reviews] INFO: Scraped item: {'review': "I didn't like the taste. felt compromised", 'review_id': 284384274, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794} 2025-03-10 01:14:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21503794&page=1> {'review': "I didn't like the taste. felt compromised", 'review_id': 284384274, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794} 2025-03-10 01:14:39 [reviews] INFO: Scraped item: {'review': 'Biryani was burnt and also handi broken', 'review_id': 283823601, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794} 2025-03-10 01:14:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21503794&page=1> {'review': 'Biryani was burnt and also handi broken', 'review_id': 283823601, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794} 2025-03-10 01:14:39 [reviews] INFO: Scraped item: {'review': '', 'review_id': 283813776, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794} 2025-03-10 01:14:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21503794&page=1> {'review': '', 'review_id': 283813776, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-09', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794} 2025-03-10 01:14:39 [reviews] INFO: Scraped item: {'review': 'Egg Biryani was extra cooked and burnt', 'review_id': 283758008, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794} 2025-03-10 01:14:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21503794&page=1> {'review': 'Egg Biryani was extra cooked and burnt', 'review_id': 283758008, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 13, 'brand_name': 'Biryani By Kilo', 'city': 'Noida', 'sub_zone': 'Sector 76', 'platform': 'zomato', 'res_id': 21503794} 2025-03-10 01:14:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:14:42 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 29, 'brand_name': 'abCoffee', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21514302, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741569223, 'download_latency': 0.702038049697876, 'depth': 0} 2025-03-10 01:14:42 [reviews] INFO: Stopping for res_id: 21514302 as reviews are older than 7 days. 2025-03-10 01:14:45 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:14:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:14:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:14:56 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:15:00 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:15:03 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:15:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-10 01:15:06 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-10 01:15:06 [scrapy.extensions.logstats] INFO: Crawled 191 pages (at 3 pages/min), scraped 648 items (at 5 items/min) 2025-03-10 01:15:07 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:15:09 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:15:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:15:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:15:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:15:22 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741569263, 'download_latency': 0.7298872470855713, 'depth': 0} 2025-03-10 01:15:22 [reviews] INFO: Scraped item: {'review': 'Burger combo 4/5
pizza - 3/5
Ginger tofu cashew rice bowl - 2/5
Pasta 4/5
passion fruit juice 5/5

must try:
Sundae
', 'review_id': 284372715, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554} 2025-03-10 01:15:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21528554&page=1> {'review': 'Burger combo 4/5
pizza - 3/5
Ginger tofu cashew rice bowl - 2/5
Pasta 4/5
passion fruit juice 5/5

must try:
Sundae
', 'review_id': 284372715, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554} 2025-03-10 01:15:22 [reviews] INFO: Scraped item: {'review': 'delayed delivery, sad sandwich and pasta - which was nothing like what Pauls we know for. their q
quality foe delivery is compreo.ised as chicken and fillings are significantly lesser.
avoidable ', 'review_id': 283729419, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554} 2025-03-10 01:15:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21528554&page=1> {'review': 'delayed delivery, sad sandwich and pasta - which was nothing like what Pauls we know for. their q
quality foe delivery is compreo.ised as chicken and fillings are significantly lesser.
avoidable ', 'review_id': 283729419, 'rating': '3', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554} 2025-03-10 01:15:22 [reviews] INFO: Scraped item: {'review': 'Spoiled food , been cheated with mawa cake', 'review_id': 283674005, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554} 2025-03-10 01:15:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21528554&page=1> {'review': 'Spoiled food , been cheated with mawa cake', 'review_id': 283674005, 'rating': '1', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554} 2025-03-10 01:15:22 [reviews] INFO: Scraped item: {'review': 'sourdough bread very hard', 'review_id': 283643894, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554} 2025-03-10 01:15:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21528554&page=1> {'review': 'sourdough bread very hard', 'review_id': 283643894, 'rating': '2', 'review_type': 'DELIVERY', 'review_date': '2025-03-08', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554} 2025-03-10 01:15:22 [reviews] INFO: Scraped item: {'review': 'thanks Nikki! for the warm hospitality.

good food and ambience overall', 'review_id': 283607959, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554} 2025-03-10 01:15:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21528554&page=1> {'review': 'thanks Nikki! for the warm hospitality.

good food and ambience overall', 'review_id': 283607959, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 34, 'brand_name': 'PAUL', 'city': 'Hyderabad ', 'sub_zone': 'Hitech City', 'platform': 'zomato', 'res_id': 21528554} 2025-03-10 01:15:25 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:15:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:15:28 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 33, 'brand_name': 'Nandan Coffee', 'city': 'Mumbai', 'sub_zone': 'Fort', 'platform': 'zomato', 'res_id': 21565814, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741569271, 'download_latency': 0.5339851379394531, 'depth': 0} 2025-03-10 01:15:28 [scrapy.core.scraper] ERROR: Spider error processing (referer: None) Traceback (most recent call last): File "/home/ubuntu/restaverse_spiders/venv/lib/python3.10/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) File "/home/ubuntu/restaverse_spiders/venv/lib/python3.10/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) File "/home/ubuntu/restaverse_spiders/venv/lib/python3.10/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) File "/home/ubuntu/restaverse_spiders/venv/lib/python3.10/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/restaverse_spiders/venv/lib/python3.10/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) File "/home/ubuntu/restaverse_spiders/venv/lib/python3.10/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/restaverse_spiders/venv/lib/python3.10/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) File "/home/ubuntu/restaverse_spiders/venv/lib/python3.10/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/restaverse_spiders/venv/lib/python3.10/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) File "/home/ubuntu/restaverse_spiders/venv/lib/python3.10/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/restaverse_spiders/eggs/zomato_competiton_analysis/1739782236.egg/zomato_competiton_analysis/spiders/reviews.py", line 81, in parse_reviews for review_id, review_data in reviews.items(): AttributeError: 'list' object has no attribute 'items' 2025-03-10 01:15:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:15:30 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 21568377, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741569275, 'download_latency': 0.7261006832122803, 'depth': 0} 2025-03-10 01:15:30 [reviews] INFO: Scraped item: {'review': '. ', 'review_id': 283212028, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 21568377} 2025-03-10 01:15:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21568377&page=1> {'review': '. ', 'review_id': 283212028, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 21568377} 2025-03-10 01:15:30 [reviews] INFO: Scraped item: {'review': 'biryani is good, but just a bit disappointed with portion size', 'review_id': 283040446, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 21568377} 2025-03-10 01:15:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21568377&page=1> {'review': 'biryani is good, but just a bit disappointed with portion size', 'review_id': 283040446, 'rating': '5', 'review_type': 'DELIVERY', 'review_date': '2025-03-06', 'competitor_id': 16, 'brand_name': 'Charcoal Eats - Biryani & Beyond', 'city': 'Mumbai', 'sub_zone': 'Goregaon East ', 'platform': 'zomato', 'res_id': 21568377} 2025-03-10 01:15:30 [reviews] INFO: Stopping for res_id: 21568377 as reviews are older than 7 days. 2025-03-10 01:15:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-03-10 01:15:35 [reviews] INFO: Meta data: {'proxy': 'http://residential-proxy.scrapeops.io:8181', 'competitor_id': 27, 'brand_name': 'Grey Soul Coffee Roasters', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 21575164, 'download_timeout': 30.0, '_auth_proxy': 'http://residential-proxy.scrapeops.io:8181', 'download_slot': 'www.zomato.com', 'sops_time': 1741569279, 'download_latency': 0.8681340217590332, 'depth': 0} 2025-03-10 01:15:35 [reviews] INFO: Scraped item: {'review': 'The shakerato was so so bad and not even cold and when we sent it back it came back as it is and we just had to leave after paying for the coffee, had heard great things but really a very bad experience', 'review_id': 283987312, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 27, 'brand_name': 'Grey Soul Coffee Roasters', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 21575164} 2025-03-10 01:15:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21575164&page=1> {'review': 'The shakerato was so so bad and not even cold and when we sent it back it came back as it is and we just had to leave after paying for the coffee, had heard great things but really a very bad experience', 'review_id': 283987312, 'rating': '1', 'review_type': 'DINING', 'review_date': '2025-03-09', 'competitor_id': 27, 'brand_name': 'Grey Soul Coffee Roasters', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 21575164} 2025-03-10 01:15:35 [reviews] INFO: Scraped item: {'review': 'Amazing food plating, quality and taste. Grounded ambiance making it perfect for a slow day. Coffee is amazing and the service is swift as well. 10/10 recommended.', 'review_id': 283614347, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 27, 'brand_name': 'Grey Soul Coffee Roasters', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 21575164} 2025-03-10 01:15:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21575164&page=1> {'review': 'Amazing food plating, quality and taste. Grounded ambiance making it perfect for a slow day. Coffee is amazing and the service is swift as well. 10/10 recommended.', 'review_id': 283614347, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 27, 'brand_name': 'Grey Soul Coffee Roasters', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 21575164} 2025-03-10 01:15:35 [reviews] INFO: Scraped item: {'review': 'So I visited based off my friend recommendation who stays close this cafe. To my surprise everything was perfect the service, the quantity of food and of course the coffee as they are roasters ! Got myself a bag of coffee for my home espresso on the way out.', 'review_id': 283611292, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 27, 'brand_name': 'Grey Soul Coffee Roasters', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 21575164} 2025-03-10 01:15:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21575164&page=1> {'review': 'So I visited based off my friend recommendation who stays close this cafe. To my surprise everything was perfect the service, the quantity of food and of course the coffee as they are roasters ! Got myself a bag of coffee for my home espresso on the way out.', 'review_id': 283611292, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-07', 'competitor_id': 27, 'brand_name': 'Grey Soul Coffee Roasters', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 21575164} 2025-03-10 01:15:35 [reviews] INFO: Scraped item: {'review': 'Scrumptious good crazyy coffee cozy vibe
Itโ€™s damn good', 'review_id': 282900622, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-05', 'competitor_id': 27, 'brand_name': 'Grey Soul Coffee Roasters', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 21575164} 2025-03-10 01:15:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.zomato.com/webroutes/reviews/loadMore?sort=dd&filter=reviews-dd&res_id=21575164&page=1> {'review': 'Scrumptious good crazyy coffee cozy vibe
Itโ€™s damn good', 'review_id': 282900622, 'rating': '5', 'review_type': 'DINING', 'review_date': '2025-03-05', 'competitor_id': 27, 'brand_name': 'Grey Soul Coffee Roasters', 'city': 'Mumbai', 'sub_zone': 'Bandra West', 'platform': 'zomato', 'res_id': 21575164} 2025-03-10 01:15:35 [reviews] INFO: Stopping for res_id: 21575164 as reviews are older than 7 days. 2025-03-10 01:15:38 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:15:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:15:44 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:15:47 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:15:51 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:15:54 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:15:58 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:16:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:16:06 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:16:06 [scrapy.extensions.logstats] INFO: Crawled 195 pages (at 4 pages/min), scraped 659 items (at 11 items/min) 2025-03-10 01:16:09 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:16:12 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 1 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:16:15 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:16:19 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:16:23 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:16:26 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:16:30 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:16:34 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:16:37 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:16:41 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:16:44 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 2 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:16:48 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:16:51 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:16:55 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:16:59 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:17:03 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:17:06 [scrapy.extensions.logstats] INFO: Crawled 195 pages (at 0 pages/min), scraped 659 items (at 0 items/min) 2025-03-10 01:17:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:17:11 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:17:14 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 3 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:17:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:17:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:17:26 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:17:30 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:17:35 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:17:38 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 4 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:17:43 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:17:46 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:17:49 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying (failed 5 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:17:53 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:17:57 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying (failed 6 times): Could not open CONNECT tunnel with proxy residential-proxy.scrapeops.io:8181 [{'status': 407, 'reason': b'Proxy Authentication Required'}] 2025-03-10 01:17:57 [scrapy.core.engine] INFO: Closing spider (finished) 2025-03-10 01:17:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): cron.restaverse.com:443 2025-03-10 01:17:57 [urllib3.connectionpool] DEBUG: https://cron.restaverse.com:443 "POST /insert_data/ HTTP/11" 201 112 2025-03-10 01:17:57 [reviews] INFO: Data posted successfully. 2025-03-10 01:17:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2025-03-10 01:17:58 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 108 2025-03-10 01:17:58 [scrapy.statscollectors] INFO: Dumping Scrapy stats: {'downloader/exception_count': 588, 'downloader/exception_type_count/scrapy.core.downloader.handlers.http11.TunnelError': 587, 'downloader/exception_type_count/twisted.internet.error.TimeoutError': 1, 'downloader/request_bytes': 705383, 'downloader/request_count': 783, 'downloader/request_method_count/GET': 783, 'downloader/response_bytes': 988198, 'downloader/response_count': 195, 'downloader/response_status_count/200': 194, 'downloader/response_status_count/400': 1, 'elapsed_time_seconds': 2871.397286, 'finish_reason': 'finished', 'finish_time': datetime.datetime(2025, 3, 10, 1, 17, 57, 830563, tzinfo=datetime.timezone.utc), 'httpcompression/response_bytes': 1816192, 'httpcompression/response_count': 194, 'item_scraped_count': 659, 'items_per_minute': None, 'log_count/DEBUG': 1419, 'log_count/ERROR': 104, 'log_count/INFO': 1006, 'memusage/max': 78446592, 'memusage/startup': 65290240, 'request_depth_max': 1, 'response_received_count': 195, 'responses_per_minute': None, 'retry/count': 490, 'retry/max_reached': 98, 'retry/reason_count/scrapy.core.downloader.handlers.http11.TunnelError': 489, 'retry/reason_count/twisted.internet.error.TimeoutError': 1, 'scheduler/dequeued': 783, 'scheduler/dequeued/memory': 783, 'scheduler/enqueued': 783, 'scheduler/enqueued/memory': 783, 'spider_exceptions/AttributeError': 1, 'start_time': datetime.datetime(2025, 3, 10, 0, 30, 6, 433277, tzinfo=datetime.timezone.utc)} 2025-03-10 01:17:58 [scrapy.core.engine] INFO: Spider closed (finished)