2026-07-09 01:41:29 [scrapy.utils.log] INFO: Scrapy 2.12.0 started (bot: zomato_check_in)
2026-07-09 01:41:29 [scrapy.utils.log] INFO: Versions: lxml 5.3.0.0, libxml2 2.12.9, cssselect 1.2.0, parsel 1.9.1, w3lib 2.2.1, Twisted 24.11.0, Python 3.10.12 (main, Jun 22 2026, 18:55:27) [GCC 11.4.0], pyOpenSSL 24.3.0 (OpenSSL 3.4.0 22 Oct 2024), cryptography 44.0.0, Platform Linux-6.8.0-1060-aws-aarch64-with-glibc2.35
2026-07-09 01:41:29 [zomato_integration_check] INFO: Dynamic attribute _job = bf6b64437b3511f182b3b7f7997b43e5
2026-07-09 01:41:29 [zomato_integration_check] INFO: Connected to Redis
2026-07-09 01:41:29 [scrapy.addons] INFO: Enabled addons:
[]
2026-07-09 01:41:29 [asyncio] DEBUG: Using selector: EpollSelector
2026-07-09 01:41:29 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-07-09 01:41:29 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-07-09 01:41:29 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-07-09 01:41:29 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-07-09 01:41:29 [scrapy.extensions.telnet] INFO: Telnet Password: a0b9e94e6367f63f
2026-07-09 01:41:29 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.logstats.LogStats',
 'scrapeops_scrapy.extension.ScrapeOpsMonitor']
2026-07-09 01:41:29 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'zomato_check_in',
 'CONCURRENT_REQUESTS': 8,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/home/ubuntu/restaverse_spiders/logs/zomato_check_in/zomato_integration_check/bf6b64437b3511f182b3b7f7997b43e5.log',
 'NEWSPIDER_MODULE': 'zomato_check_in.spiders',
 'RETRY_HTTP_CODES': [403, 500, 502, 503, 504, 408],
 'RETRY_TIMES': 1,
 'SPIDER_MODULES': ['zomato_check_in.spiders'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor'}
2026-07-09 01:41:32 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'zomato_check_in.middlewares.ZomatoCentralRateLimitMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy_user_agents.middlewares.RandomUserAgentMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapeops_scrapy.middleware.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-07-09 01:41:32 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-07-09 01:41:32 [scrapy.middleware] INFO: Enabled item pipelines:
['zomato_check_in.pipelines.ZomatoCheckInPipeline']
2026-07-09 01:41:32 [scrapy.core.engine] INFO: Spider opened
2026-07-09 01:41:32 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-07-09 01:41:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2026-07-09 01:41:33 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/setup/ HTTP/11" 200 None
2026-07-09 01:41:33 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6025
2026-07-09 01:41:33 [zomato_integration_check] INFO: No Redis session found for client_id=269, falling back to DB
2026-07-09 01:41:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): cron.restaverse.com:443
2026-07-09 01:41:33 [urllib3.connectionpool] DEBUG: https://cron.restaverse.com:443 "POST /api/db_services/fetch-query HTTP/11" 200 3590
2026-07-09 01:41:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2026-07-09 01:41:34 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/normalizer/proxy_port/?job_id=7238423 HTTP/11" 200 None
2026-07-09 01:41:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2026-07-09 01:41:34 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/normalizer/domain/?domain=zomato.com HTTP/11" 200 241
2026-07-09 01:41:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/auth/csrf> (referer: https://www.zomato.com/)
2026-07-09 01:41:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2026-07-09 01:41:37 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/normalizer/domain/?domain=restaverse.com HTTP/11" 200 245
2026-07-09 01:41:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://cron.restaverse.com/api/db_services/fetch-query> (referer: https://www.zomato.com/webroutes/auth/csrf)
2026-07-09 01:41:38 [zomato_integration_check] INFO: Found 98 restaurant IDs from database for client_id 269
2026-07-09 01:41:39 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21902679&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21902679)
2026-07-09 01:41:41 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21901863&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21901863)
2026-07-09 01:41:41 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21902139&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21902139)
2026-07-09 01:41:42 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21901725&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21901725)
2026-07-09 01:41:42 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21721191&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21721191)
2026-07-09 01:41:42 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21898870&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21898870)
2026-07-09 01:41:43 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21636763&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21636763)
2026-07-09 01:41:43 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21749789&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21749789)
2026-07-09 01:41:44 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21921568&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21921568)
2026-07-09 01:41:45 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21922235&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21922235)
2026-07-09 01:41:45 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21921909&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21921909)
2026-07-09 01:41:46 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=19837800&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=19837800)
2026-07-09 01:41:46 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=19821553&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=19821553)
2026-07-09 01:41:47 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21921650&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21921650)
2026-07-09 01:41:48 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21921938&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21921938)
2026-07-09 01:41:48 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21922254&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21922254)
2026-07-09 01:41:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2026-07-09 01:41:49 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 109
2026-07-09 01:41:49 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=19495287&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=19495287)
2026-07-09 01:41:49 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=19417513&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=19417513)
2026-07-09 01:41:50 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=19722829&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=19722829)
2026-07-09 01:41:50 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=18962224&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=18962224)
2026-07-09 01:41:51 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=305833&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=305833)
2026-07-09 01:41:51 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=20363515&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=20363515)
2026-07-09 01:41:52 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=18334419&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=18334419)
2026-07-09 01:41:52 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=310887&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=310887)
2026-07-09 01:41:53 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=17977775&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=17977775)
2026-07-09 01:41:54 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21903006&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21903006)
2026-07-09 01:41:55 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21902989&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21902989)
2026-07-09 01:41:55 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21902955&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21902955)
2026-07-09 01:41:56 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21902962&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21902962)
2026-07-09 01:41:56 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=18937925&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=18937925)
2026-07-09 01:41:57 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21721544&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21721544)
2026-07-09 01:41:58 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21902978&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21902978)
2026-07-09 01:41:58 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21721534&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21721534)
2026-07-09 01:41:59 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21749418&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21749418)
2026-07-09 01:41:59 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21721537&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21721537)
2026-07-09 01:42:00 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21916751&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21916751)
2026-07-09 01:42:00 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21902742&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21902742)
2026-07-09 01:42:01 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21642417&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21642417)
2026-07-09 01:42:01 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21721542&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21721542)
2026-07-09 01:42:02 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21642408&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21642408)
2026-07-09 01:42:03 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21642402&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21642402)
2026-07-09 01:42:03 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21636705&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21636705)
2026-07-09 01:42:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2026-07-09 01:42:04 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 109
2026-07-09 01:42:04 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21642390&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21642390)
2026-07-09 01:42:04 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21636743&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21636743)
2026-07-09 01:42:05 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21491808&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21491808)
2026-07-09 01:42:05 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21636731&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21636731)
2026-07-09 01:42:06 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21642411&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21642411)
2026-07-09 01:42:06 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21636738&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21636738)
2026-07-09 01:42:07 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21491801&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21491801)
2026-07-09 01:42:08 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21642398&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21642398)
2026-07-09 01:42:08 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21636700&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21636700)
2026-07-09 01:42:08 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=19173568&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=19173568)
2026-07-09 01:42:09 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21615384&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21615384)
2026-07-09 01:42:09 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21615231&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21615231)
2026-07-09 01:42:10 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21615422&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21615422)
2026-07-09 01:42:11 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21615241&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21615241)
2026-07-09 01:42:11 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21615270&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21615270)
2026-07-09 01:42:12 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=18777091&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=18777091)
2026-07-09 01:42:13 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=70684&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=70684)
2026-07-09 01:42:13 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=71629&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=71629)
2026-07-09 01:42:14 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=20748097&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=20748097)
2026-07-09 01:42:14 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21615392&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21615392)
2026-07-09 01:42:15 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=20551580&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=20551580)
2026-07-09 01:42:15 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=20064562&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=20064562)
2026-07-09 01:42:16 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=71417&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=71417)
2026-07-09 01:42:16 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21615418&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21615418)
2026-07-09 01:42:17 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=19450623&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=19450623)
2026-07-09 01:42:17 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=19689064&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=19689064)
2026-07-09 01:42:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2026-07-09 01:42:19 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 109
2026-07-09 01:42:19 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=19450618&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=19450618)
2026-07-09 01:42:19 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=19468287&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=19468287)
2026-07-09 01:42:19 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21781746&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21781746)
2026-07-09 01:42:20 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=19584562&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=19584562)
2026-07-09 01:42:20 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=19450621&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=19450621)
2026-07-09 01:42:21 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21780314&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21780314)
2026-07-09 01:42:21 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=20946661&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=20946661)
2026-07-09 01:42:22 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21805429&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21805429)
2026-07-09 01:42:22 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21149118&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21149118)
2026-07-09 01:42:23 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21158765&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21158765)
2026-07-09 01:42:23 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=20012334&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=20012334)
2026-07-09 01:42:24 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=20903358&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=20903358)
2026-07-09 01:42:25 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=20841046&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=20841046)
2026-07-09 01:42:25 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=19120125&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=19120125)
2026-07-09 01:42:25 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=18674651&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=18674651)
2026-07-09 01:42:26 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=56872&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=56872)
2026-07-09 01:42:27 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=55118&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=55118)
2026-07-09 01:42:27 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=19690587&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=19690587)
2026-07-09 01:42:28 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=19210811&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=19210811)
2026-07-09 01:42:29 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=18369807&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=18369807)
2026-07-09 01:42:29 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=57225&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=57225)
2026-07-09 01:42:29 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=56481&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=56481)
2026-07-09 01:42:30 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=20785501&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=20785501)
2026-07-09 01:42:30 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=60503&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=60503)
2026-07-09 01:42:31 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=58299&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=58299)
2026-07-09 01:42:32 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=61491&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=61491)
2026-07-09 01:42:32 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21132520&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21132520)
2026-07-09 01:42:32 [scrapy.extensions.logstats] INFO: Crawled 97 pages (at 97 pages/min), scraped 0 items (at 0 items/min)
2026-07-09 01:42:32 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=56479&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=56479)
2026-07-09 01:42:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2026-07-09 01:42:34 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 109
2026-07-09 01:42:34 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=18777053&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=18777053)
2026-07-09 01:42:34 [scrapy.core.engine] DEBUG: Crawled (401) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=59461&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=59461)
2026-07-09 01:42:34 [scrapy.core.engine] INFO: Closing spider (finished)
2026-07-09 01:42:34 [zomato_integration_check] INFO: No items scraped. Skipping DB update.
2026-07-09 01:42:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2026-07-09 01:42:34 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 109
2026-07-09 01:42:34 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'client_id': '269',
 'downloader/request_bytes': 433141,
 'downloader/request_count': 100,
 'downloader/request_method_count/GET': 99,
 'downloader/request_method_count/POST': 1,
 'downloader/response_bytes': 373215,
 'downloader/response_count': 100,
 'downloader/response_status_count/200': 2,
 'downloader/response_status_count/401': 98,
 'elapsed_time_seconds': 61.374114,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 7, 9, 1, 42, 34, 123842, tzinfo=datetime.timezone.utc),
 'httpcompression/response_bytes': 70,
 'httpcompression/response_count': 1,
 'items_per_minute': None,
 'log_count/DEBUG': 125,
 'log_count/INFO': 14,
 'memusage/max': 131362816,
 'memusage/startup': 118386688,
 'request_depth_max': 2,
 'response_received_count': 100,
 'responses_per_minute': None,
 'scheduler/dequeued': 100,
 'scheduler/dequeued/memory': 100,
 'scheduler/enqueued': 100,
 'scheduler/enqueued/memory': 100,
 'start_time': datetime.datetime(2026, 7, 9, 1, 41, 32, 749728, tzinfo=datetime.timezone.utc)}
2026-07-09 01:42:34 [scrapy.core.engine] INFO: Spider closed (finished)