2026-01-10 03:35:30 [scrapy.utils.log] INFO: Scrapy 2.12.0 started (bot: zomato_check_in)
2026-01-10 03:35:30 [scrapy.utils.log] INFO: Versions: lxml 5.3.0.0, libxml2 2.12.9, cssselect 1.2.0, parsel 1.9.1, w3lib 2.2.1, Twisted 24.11.0, Python 3.10.12 (main, Nov  4 2025, 08:48:33) [GCC 11.4.0], pyOpenSSL 24.3.0 (OpenSSL 3.4.0 22 Oct 2024), cryptography 44.0.0, Platform Linux-6.8.0-1044-aws-aarch64-with-glibc2.35
2026-01-10 03:35:30 [zomato_integration_check] INFO: Dynamic attribute _job = 492b6a16edd511f091f6bbf0a74f61c7
2026-01-10 03:35:30 [scrapy.addons] INFO: Enabled addons:
[]
2026-01-10 03:35:30 [asyncio] DEBUG: Using selector: EpollSelector
2026-01-10 03:35:30 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-01-10 03:35:30 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-01-10 03:35:30 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-01-10 03:35:30 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-01-10 03:35:30 [scrapy.extensions.telnet] INFO: Telnet Password: 0c86b6ee3922634b
2026-01-10 03:35:30 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.logstats.LogStats',
 'scrapy_extensions.extension.BandwidthLoggerExtension',
 'scrapeops_scrapy.extension.ScrapeOpsMonitor']
2026-01-10 03:35:30 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'zomato_check_in',
 'DOWNLOAD_DELAY': 3,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/home/ubuntu/restaverse_spiders/logs/zomato_check_in/zomato_integration_check/492b6a16edd511f091f6bbf0a74f61c7.log',
 'NEWSPIDER_MODULE': 'zomato_check_in.spiders',
 'RETRY_HTTP_CODES': [403, 500, 502, 503, 504, 408],
 'SPIDER_MODULES': ['zomato_check_in.spiders'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor'}
2026-01-10 03:35:30 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapeops_scrapy.middleware.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-01-10 03:35:30 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-01-10 03:35:30 [scrapy.middleware] INFO: Enabled item pipelines:
['zomato_check_in.pipelines.ZomatoCheckInPipeline']
2026-01-10 03:35:30 [scrapy.core.engine] INFO: Spider opened
2026-01-10 03:35:30 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-01-10 03:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2026-01-10 03:35:30 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/setup/ HTTP/11" 200 None
2026-01-10 03:35:30 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6028
2026-01-10 03:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): cron.restaverse.com:443
2026-01-10 03:35:31 [urllib3.connectionpool] DEBUG: https://cron.restaverse.com:443 "POST /api/db_services/fetch-query HTTP/11" 200 2895
2026-01-10 03:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2026-01-10 03:35:31 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/normalizer/proxy_port/?job_id=5873145 HTTP/11" 200 None
2026-01-10 03:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2026-01-10 03:35:32 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/normalizer/domain/?domain=zomato.com HTTP/11" 200 241
2026-01-10 03:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/auth/csrf> (referer: https://www.zomato.com/partners/onlineordering/orderHistory/)
2026-01-10 03:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2026-01-10 03:35:34 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/normalizer/domain/?domain=restaverse.com HTTP/11" 200 245
2026-01-10 03:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://cron.restaverse.com/api/db_services/fetch-query> (referer: https://www.zomato.com/webroutes/auth/csrf)
2026-01-10 03:35:36 [zomato_integration_check] INFO: Found 20 restaurant IDs from database for client_id 2
2026-01-10 03:35:37 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21549716&business_type=o2> (failed 1 times): 403 Forbidden
2026-01-10 03:35:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21548098&business_type=o2> (failed 1 times): 403 Forbidden
2026-01-10 03:35:44 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=20501458&business_type=o2> (failed 1 times): 403 Forbidden
2026-01-10 03:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2026-01-10 03:35:45 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 109
2026-01-10 03:35:47 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21449344&business_type=o2> (failed 1 times): 403 Forbidden
2026-01-10 03:35:51 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=19925227&business_type=o2> (failed 1 times): 403 Forbidden
2026-01-10 03:35:56 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21394383&business_type=o2> (failed 1 times): 403 Forbidden
2026-01-10 03:35:59 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21394360&business_type=o2> (failed 1 times): 403 Forbidden
2026-01-10 03:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2026-01-10 03:36:00 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 109
2026-01-10 03:36:02 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21394371&business_type=o2> (failed 1 times): 403 Forbidden
2026-01-10 03:36:05 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21414946&business_type=o2> (failed 1 times): 403 Forbidden
2026-01-10 03:36:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21394340&business_type=o2> (failed 1 times): 403 Forbidden
2026-01-10 03:36:11 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21644533&business_type=o2> (failed 1 times): 403 Forbidden
2026-01-10 03:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2026-01-10 03:36:15 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 109
2026-01-10 03:36:15 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21644555&business_type=o2> (failed 1 times): 403 Forbidden
2026-01-10 03:36:18 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=20936533&business_type=o2> (failed 1 times): 403 Forbidden
2026-01-10 03:36:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21198980&business_type=o2> (failed 1 times): 403 Forbidden
2026-01-10 03:36:25 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21198885&business_type=o2> (failed 1 times): 403 Forbidden
2026-01-10 03:36:29 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21198859&business_type=o2> (failed 1 times): 403 Forbidden
2026-01-10 03:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2026-01-10 03:36:30 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 109
2026-01-10 03:36:30 [scrapy.extensions.logstats] INFO: Crawled 2 pages (at 2 pages/min), scraped 0 items (at 0 items/min)
2026-01-10 03:36:33 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21198848&business_type=o2> (failed 1 times): 403 Forbidden
2026-01-10 03:36:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21198865&business_type=o2> (failed 1 times): 403 Forbidden
2026-01-10 03:36:39 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21198825&business_type=o2> (failed 1 times): 403 Forbidden
2026-01-10 03:36:43 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=1008&business_type=o2> (failed 1 times): 403 Forbidden
2026-01-10 03:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2026-01-10 03:36:45 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 109
2026-01-10 03:36:47 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=19925227&business_type=o2> (failed 2 times): 403 Forbidden
2026-01-10 03:36:52 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21394383&business_type=o2> (failed 2 times): 403 Forbidden
2026-01-10 03:36:56 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21394360&business_type=o2> (failed 2 times): 403 Forbidden
2026-01-10 03:36:59 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21394371&business_type=o2> (failed 2 times): 403 Forbidden
2026-01-10 03:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2026-01-10 03:37:00 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 109
2026-01-10 03:37:03 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21414946&business_type=o2> (failed 2 times): 403 Forbidden
2026-01-10 03:37:07 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21394340&business_type=o2> (failed 2 times): 403 Forbidden
2026-01-10 03:37:11 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21644533&business_type=o2> (failed 2 times): 403 Forbidden
2026-01-10 03:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2026-01-10 03:37:15 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 109
2026-01-10 03:37:16 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21644555&business_type=o2> (failed 2 times): 403 Forbidden
2026-01-10 03:37:19 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=20936533&business_type=o2> (failed 2 times): 403 Forbidden
2026-01-10 03:37:22 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21198980&business_type=o2> (failed 2 times): 403 Forbidden
2026-01-10 03:37:25 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21198885&business_type=o2> (failed 2 times): 403 Forbidden
2026-01-10 03:37:28 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21198859&business_type=o2> (failed 2 times): 403 Forbidden
2026-01-10 03:37:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2026-01-10 03:37:30 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 109
2026-01-10 03:37:30 [scrapy.extensions.logstats] INFO: Crawled 2 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-01-10 03:37:32 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21198848&business_type=o2> (failed 2 times): 403 Forbidden
2026-01-10 03:37:36 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21198865&business_type=o2> (failed 2 times): 403 Forbidden
2026-01-10 03:37:40 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21198825&business_type=o2> (failed 2 times): 403 Forbidden
2026-01-10 03:37:44 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=1008&business_type=o2> (failed 2 times): 403 Forbidden
2026-01-10 03:37:46 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21449344&business_type=o2> (failed 2 times): 403 Forbidden
2026-01-10 03:37:50 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=20501458&business_type=o2> (failed 2 times): 403 Forbidden
2026-01-10 03:37:54 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21548098&business_type=o2> (failed 2 times): 403 Forbidden
2026-01-10 03:37:57 [scrapeops_scrapy.middleware.retry] DEBUG: Retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21549716&business_type=o2> (failed 2 times): 403 Forbidden
2026-01-10 03:37:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2026-01-10 03:38:00 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 109
2026-01-10 03:38:00 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21414946&business_type=o2> (failed 3 times): 403 Forbidden
2026-01-10 03:38:00 [scrapy.core.engine] DEBUG: Crawled (403) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21414946&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21414946)
2026-01-10 03:38:00 [zomato_integration_check] ERROR: 403 Forbidden for res_id 21414946. Response: {"status":false,"code":1020,"message":"Not authorised for the restaurant","display":{"image":"https:\/\/b.zmtcdn.com\/data\/o2_assets\/241d53f646972ed0ffb41193f7e188f71622638524.png","title":"Oops! Access denied","subtitle":"You are not authorised to access this outlet anymore","cta":{"text":"Switch outlet","bg_color":"#256FEF","deeplink":"zomato-merchant:\/\/switch_outlet"}}}
2026-01-10 03:38:00 [scrapy.core.scraper] DEBUG: Scraped from <403 https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21414946&business_type=o2>
None
2026-01-10 03:38:04 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21394340&business_type=o2> (failed 3 times): 403 Forbidden
2026-01-10 03:38:04 [scrapy.core.engine] DEBUG: Crawled (403) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21394340&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21394340)
2026-01-10 03:38:04 [zomato_integration_check] ERROR: 403 Forbidden for res_id 21394340. Response: {"status":false,"code":1020,"message":"Not authorised for the restaurant","display":{"image":"https:\/\/b.zmtcdn.com\/data\/o2_assets\/241d53f646972ed0ffb41193f7e188f71622638524.png","title":"Oops! Access denied","subtitle":"You are not authorised to access this outlet anymore","cta":{"text":"Switch outlet","bg_color":"#256FEF","deeplink":"zomato-merchant:\/\/switch_outlet"}}}
2026-01-10 03:38:04 [scrapy.core.scraper] DEBUG: Scraped from <403 https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21394340&business_type=o2>
None
2026-01-10 03:38:07 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21644533&business_type=o2> (failed 3 times): 403 Forbidden
2026-01-10 03:38:07 [scrapy.core.engine] DEBUG: Crawled (403) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21644533&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21644533)
2026-01-10 03:38:07 [zomato_integration_check] ERROR: 403 Forbidden for res_id 21644533. Response: {"status":false,"code":1020,"message":"Not authorised for the restaurant","display":{"image":"https:\/\/b.zmtcdn.com\/data\/o2_assets\/241d53f646972ed0ffb41193f7e188f71622638524.png","title":"Oops! Access denied","subtitle":"You are not authorised to access this outlet anymore","cta":{"text":"Switch outlet","bg_color":"#256FEF","deeplink":"zomato-merchant:\/\/switch_outlet"}}}
2026-01-10 03:38:07 [scrapy.core.scraper] DEBUG: Scraped from <403 https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21644533&business_type=o2>
None
2026-01-10 03:38:11 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21644555&business_type=o2> (failed 3 times): 403 Forbidden
2026-01-10 03:38:11 [scrapy.core.engine] DEBUG: Crawled (403) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21644555&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21644555)
2026-01-10 03:38:11 [zomato_integration_check] ERROR: 403 Forbidden for res_id 21644555. Response: {"status":false,"code":1020,"message":"Not authorised for the restaurant","display":{"image":"https:\/\/b.zmtcdn.com\/data\/o2_assets\/241d53f646972ed0ffb41193f7e188f71622638524.png","title":"Oops! Access denied","subtitle":"You are not authorised to access this outlet anymore","cta":{"text":"Switch outlet","bg_color":"#256FEF","deeplink":"zomato-merchant:\/\/switch_outlet"}}}
2026-01-10 03:38:11 [scrapy.core.scraper] DEBUG: Scraped from <403 https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21644555&business_type=o2>
None
2026-01-10 03:38:14 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=20936533&business_type=o2> (failed 3 times): 403 Forbidden
2026-01-10 03:38:14 [scrapy.core.engine] DEBUG: Crawled (403) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=20936533&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=20936533)
2026-01-10 03:38:14 [zomato_integration_check] ERROR: 403 Forbidden for res_id 20936533. Response: {"status":false,"code":1020,"message":"Not authorised for the restaurant","display":{"image":"https:\/\/b.zmtcdn.com\/data\/o2_assets\/241d53f646972ed0ffb41193f7e188f71622638524.png","title":"Oops! Access denied","subtitle":"You are not authorised to access this outlet anymore","cta":{"text":"Switch outlet","bg_color":"#256FEF","deeplink":"zomato-merchant:\/\/switch_outlet"}}}
2026-01-10 03:38:14 [scrapy.core.scraper] DEBUG: Scraped from <403 https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=20936533&business_type=o2>
None
2026-01-10 03:38:19 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21198980&business_type=o2> (failed 3 times): 403 Forbidden
2026-01-10 03:38:19 [scrapy.core.engine] DEBUG: Crawled (403) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21198980&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21198980)
2026-01-10 03:38:19 [zomato_integration_check] ERROR: 403 Forbidden for res_id 21198980. Response: {"status":false,"code":1020,"message":"Not authorised for the restaurant","display":{"image":"https:\/\/b.zmtcdn.com\/data\/o2_assets\/241d53f646972ed0ffb41193f7e188f71622638524.png","title":"Oops! Access denied","subtitle":"You are not authorised to access this outlet anymore","cta":{"text":"Switch outlet","bg_color":"#256FEF","deeplink":"zomato-merchant:\/\/switch_outlet"}}}
2026-01-10 03:38:19 [scrapy.core.scraper] DEBUG: Scraped from <403 https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21198980&business_type=o2>
None
2026-01-10 03:38:22 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21198885&business_type=o2> (failed 3 times): 403 Forbidden
2026-01-10 03:38:22 [scrapy.core.engine] DEBUG: Crawled (403) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21198885&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21198885)
2026-01-10 03:38:22 [zomato_integration_check] ERROR: 403 Forbidden for res_id 21198885. Response: {"status":false,"code":1020,"message":"Not authorised for the restaurant","display":{"image":"https:\/\/b.zmtcdn.com\/data\/o2_assets\/241d53f646972ed0ffb41193f7e188f71622638524.png","title":"Oops! Access denied","subtitle":"You are not authorised to access this outlet anymore","cta":{"text":"Switch outlet","bg_color":"#256FEF","deeplink":"zomato-merchant:\/\/switch_outlet"}}}
2026-01-10 03:38:22 [scrapy.core.scraper] DEBUG: Scraped from <403 https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21198885&business_type=o2>
None
2026-01-10 03:38:26 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21198859&business_type=o2> (failed 3 times): 403 Forbidden
2026-01-10 03:38:26 [scrapy.core.engine] DEBUG: Crawled (403) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21198859&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21198859)
2026-01-10 03:38:26 [zomato_integration_check] ERROR: 403 Forbidden for res_id 21198859. Response: {"status":false,"code":1020,"message":"Not authorised for the restaurant","display":{"image":"https:\/\/b.zmtcdn.com\/data\/o2_assets\/241d53f646972ed0ffb41193f7e188f71622638524.png","title":"Oops! Access denied","subtitle":"You are not authorised to access this outlet anymore","cta":{"text":"Switch outlet","bg_color":"#256FEF","deeplink":"zomato-merchant:\/\/switch_outlet"}}}
2026-01-10 03:38:26 [scrapy.core.scraper] DEBUG: Scraped from <403 https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21198859&business_type=o2>
None
2026-01-10 03:38:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2026-01-10 03:38:30 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 109
2026-01-10 03:38:30 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21198848&business_type=o2> (failed 3 times): 403 Forbidden
2026-01-10 03:38:30 [scrapy.core.engine] DEBUG: Crawled (403) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21198848&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21198848)
2026-01-10 03:38:30 [scrapy.extensions.logstats] INFO: Crawled 11 pages (at 9 pages/min), scraped 8 items (at 8 items/min)
2026-01-10 03:38:30 [zomato_integration_check] ERROR: 403 Forbidden for res_id 21198848. Response: {"status":false,"code":1020,"message":"Not authorised for the restaurant","display":{"image":"https:\/\/b.zmtcdn.com\/data\/o2_assets\/241d53f646972ed0ffb41193f7e188f71622638524.png","title":"Oops! Access denied","subtitle":"You are not authorised to access this outlet anymore","cta":{"text":"Switch outlet","bg_color":"#256FEF","deeplink":"zomato-merchant:\/\/switch_outlet"}}}
2026-01-10 03:38:30 [scrapy.core.scraper] DEBUG: Scraped from <403 https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21198848&business_type=o2>
None
2026-01-10 03:38:33 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21198865&business_type=o2> (failed 3 times): 403 Forbidden
2026-01-10 03:38:33 [scrapy.core.engine] DEBUG: Crawled (403) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21198865&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21198865)
2026-01-10 03:38:34 [zomato_integration_check] ERROR: 403 Forbidden for res_id 21198865. Response: {"status":false,"code":1020,"message":"Not authorised for the restaurant","display":{"image":"https:\/\/b.zmtcdn.com\/data\/o2_assets\/241d53f646972ed0ffb41193f7e188f71622638524.png","title":"Oops! Access denied","subtitle":"You are not authorised to access this outlet anymore","cta":{"text":"Switch outlet","bg_color":"#256FEF","deeplink":"zomato-merchant:\/\/switch_outlet"}}}
2026-01-10 03:38:34 [scrapy.core.scraper] DEBUG: Scraped from <403 https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21198865&business_type=o2>
None
2026-01-10 03:38:37 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21198825&business_type=o2> (failed 3 times): 403 Forbidden
2026-01-10 03:38:37 [scrapy.core.engine] DEBUG: Crawled (403) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21198825&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21198825)
2026-01-10 03:38:37 [zomato_integration_check] ERROR: 403 Forbidden for res_id 21198825. Response: {"status":false,"code":1020,"message":"Not authorised for the restaurant","display":{"image":"https:\/\/b.zmtcdn.com\/data\/o2_assets\/241d53f646972ed0ffb41193f7e188f71622638524.png","title":"Oops! Access denied","subtitle":"You are not authorised to access this outlet anymore","cta":{"text":"Switch outlet","bg_color":"#256FEF","deeplink":"zomato-merchant:\/\/switch_outlet"}}}
2026-01-10 03:38:37 [scrapy.core.scraper] DEBUG: Scraped from <403 https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21198825&business_type=o2>
None
2026-01-10 03:38:41 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=1008&business_type=o2> (failed 3 times): 403 Forbidden
2026-01-10 03:38:41 [scrapy.core.engine] DEBUG: Crawled (403) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=1008&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=1008)
2026-01-10 03:38:41 [zomato_integration_check] ERROR: 403 Forbidden for res_id 1008. Response: {"status":false,"code":1020,"message":"Not authorised for the restaurant","display":{"image":"https:\/\/b.zmtcdn.com\/data\/o2_assets\/241d53f646972ed0ffb41193f7e188f71622638524.png","title":"Oops! Access denied","subtitle":"You are not authorised to access this outlet anymore","cta":{"text":"Switch outlet","bg_color":"#256FEF","deeplink":"zomato-merchant:\/\/switch_outlet"}}}
2026-01-10 03:38:41 [scrapy.core.scraper] DEBUG: Scraped from <403 https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=1008&business_type=o2>
None
2026-01-10 03:38:43 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21449344&business_type=o2> (failed 3 times): 403 Forbidden
2026-01-10 03:38:43 [scrapy.core.engine] DEBUG: Crawled (403) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21449344&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21449344)
2026-01-10 03:38:43 [zomato_integration_check] ERROR: 403 Forbidden for res_id 21449344. Response: {"status":false,"code":1020,"message":"Not authorised for the restaurant","display":{"image":"https:\/\/b.zmtcdn.com\/data\/o2_assets\/241d53f646972ed0ffb41193f7e188f71622638524.png","title":"Oops! Access denied","subtitle":"You are not authorised to access this outlet anymore","cta":{"text":"Switch outlet","bg_color":"#256FEF","deeplink":"zomato-merchant:\/\/switch_outlet"}}}
2026-01-10 03:38:43 [scrapy.core.scraper] DEBUG: Scraped from <403 https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21449344&business_type=o2>
None
2026-01-10 03:38:47 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=20501458&business_type=o2> (failed 3 times): 403 Forbidden
2026-01-10 03:38:47 [scrapy.core.engine] DEBUG: Crawled (403) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=20501458&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=20501458)
2026-01-10 03:38:47 [zomato_integration_check] ERROR: 403 Forbidden for res_id 20501458. Response: {"status":false,"code":1020,"message":"Not authorised for the restaurant","display":{"image":"https:\/\/b.zmtcdn.com\/data\/o2_assets\/241d53f646972ed0ffb41193f7e188f71622638524.png","title":"Oops! Access denied","subtitle":"You are not authorised to access this outlet anymore","cta":{"text":"Switch outlet","bg_color":"#256FEF","deeplink":"zomato-merchant:\/\/switch_outlet"}}}
2026-01-10 03:38:47 [scrapy.core.scraper] DEBUG: Scraped from <403 https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=20501458&business_type=o2>
None
2026-01-10 03:38:51 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21548098&business_type=o2> (failed 3 times): 403 Forbidden
2026-01-10 03:38:51 [scrapy.core.engine] DEBUG: Crawled (403) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21548098&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21548098)
2026-01-10 03:38:51 [zomato_integration_check] ERROR: 403 Forbidden for res_id 21548098. Response: {"status":false,"code":1020,"message":"Not authorised for the restaurant","display":{"image":"https:\/\/b.zmtcdn.com\/data\/o2_assets\/241d53f646972ed0ffb41193f7e188f71622638524.png","title":"Oops! Access denied","subtitle":"You are not authorised to access this outlet anymore","cta":{"text":"Switch outlet","bg_color":"#256FEF","deeplink":"zomato-merchant:\/\/switch_outlet"}}}
2026-01-10 03:38:51 [scrapy.core.scraper] DEBUG: Scraped from <403 https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21548098&business_type=o2>
None
2026-01-10 03:38:55 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21549716&business_type=o2> (failed 3 times): 403 Forbidden
2026-01-10 03:38:55 [scrapy.core.engine] DEBUG: Crawled (403) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21549716&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21549716)
2026-01-10 03:38:56 [zomato_integration_check] ERROR: 403 Forbidden for res_id 21549716. Response: {"status":false,"code":1020,"message":"Not authorised for the restaurant","display":{"image":"https:\/\/b.zmtcdn.com\/data\/o2_assets\/241d53f646972ed0ffb41193f7e188f71622638524.png","title":"Oops! Access denied","subtitle":"You are not authorised to access this outlet anymore","cta":{"text":"Switch outlet","bg_color":"#256FEF","deeplink":"zomato-merchant:\/\/switch_outlet"}}}
2026-01-10 03:38:56 [scrapy.core.scraper] DEBUG: Scraped from <403 https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21549716&business_type=o2>
None
2026-01-10 03:38:58 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21394371&business_type=o2> (failed 3 times): 403 Forbidden
2026-01-10 03:38:58 [scrapy.core.engine] DEBUG: Crawled (403) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21394371&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21394371)
2026-01-10 03:38:58 [zomato_integration_check] ERROR: 403 Forbidden for res_id 21394371. Response: {"status":false,"code":1020,"message":"Not authorised for the restaurant","display":{"image":"https:\/\/b.zmtcdn.com\/data\/o2_assets\/241d53f646972ed0ffb41193f7e188f71622638524.png","title":"Oops! Access denied","subtitle":"You are not authorised to access this outlet anymore","cta":{"text":"Switch outlet","bg_color":"#256FEF","deeplink":"zomato-merchant:\/\/switch_outlet"}}}
2026-01-10 03:38:58 [scrapy.core.scraper] DEBUG: Scraped from <403 https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21394371&business_type=o2>
None
2026-01-10 03:38:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2026-01-10 03:39:00 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 109
2026-01-10 03:39:01 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21394360&business_type=o2> (failed 3 times): 403 Forbidden
2026-01-10 03:39:01 [scrapy.core.engine] DEBUG: Crawled (403) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21394360&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21394360)
2026-01-10 03:39:01 [zomato_integration_check] ERROR: 403 Forbidden for res_id 21394360. Response: {"status":false,"code":1020,"message":"Not authorised for the restaurant","display":{"image":"https:\/\/b.zmtcdn.com\/data\/o2_assets\/241d53f646972ed0ffb41193f7e188f71622638524.png","title":"Oops! Access denied","subtitle":"You are not authorised to access this outlet anymore","cta":{"text":"Switch outlet","bg_color":"#256FEF","deeplink":"zomato-merchant:\/\/switch_outlet"}}}
2026-01-10 03:39:01 [scrapy.core.scraper] DEBUG: Scraped from <403 https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21394360&business_type=o2>
None
2026-01-10 03:39:05 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21394383&business_type=o2> (failed 3 times): 403 Forbidden
2026-01-10 03:39:05 [scrapy.core.engine] DEBUG: Crawled (403) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21394383&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=21394383)
2026-01-10 03:39:05 [zomato_integration_check] ERROR: 403 Forbidden for res_id 21394383. Response: {"status":false,"code":1020,"message":"Not authorised for the restaurant","display":{"image":"https:\/\/b.zmtcdn.com\/data\/o2_assets\/241d53f646972ed0ffb41193f7e188f71622638524.png","title":"Oops! Access denied","subtitle":"You are not authorised to access this outlet anymore","cta":{"text":"Switch outlet","bg_color":"#256FEF","deeplink":"zomato-merchant:\/\/switch_outlet"}}}
2026-01-10 03:39:05 [scrapy.core.scraper] DEBUG: Scraped from <403 https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=21394383&business_type=o2>
None
2026-01-10 03:39:09 [scrapeops_scrapy.middleware.retry] ERROR: Gave up retrying <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=19925227&business_type=o2> (failed 3 times): 403 Forbidden
2026-01-10 03:39:09 [scrapy.core.engine] DEBUG: Crawled (403) <GET https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=19925227&business_type=o2> (referer: https://www.zomato.com/partners/onlineordering/outletInfo/contactDetails?resId=19925227)
2026-01-10 03:39:09 [zomato_integration_check] ERROR: 403 Forbidden for res_id 19925227. Response: {"status":false,"code":1020,"message":"Not authorised for the restaurant","display":{"image":"https:\/\/b.zmtcdn.com\/data\/o2_assets\/241d53f646972ed0ffb41193f7e188f71622638524.png","title":"Oops! Access denied","subtitle":"You are not authorised to access this outlet anymore","cta":{"text":"Switch outlet","bg_color":"#256FEF","deeplink":"zomato-merchant:\/\/switch_outlet"}}}
2026-01-10 03:39:09 [scrapy.core.scraper] DEBUG: Scraped from <403 https://www.zomato.com/merchant-api/contacts/v2/get-all?res_id=19925227&business_type=o2>
None
2026-01-10 03:39:09 [scrapy.core.engine] INFO: Closing spider (finished)
2026-01-10 03:39:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): cron.restaverse.com:443
2026-01-10 03:39:09 [urllib3.connectionpool] DEBUG: https://cron.restaverse.com:443 "POST /api/db_services/fetch-query HTTP/11" 200 916
2026-01-10 03:39:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): cron.restaverse.com:443
2026-01-10 03:39:09 [urllib3.connectionpool] DEBUG: https://cron.restaverse.com:443 "POST /insert_data_with_update/ HTTP/11" 201 91
2026-01-10 03:39:09 [zomato_integration_check] INFO: <Response [201]>
2026-01-10 03:39:09 [zomato_integration_check] INFO: Logger Payload: {'run_id': '4947ee27-64b0-48aa-a6bc-df28bccb5db3', 'timestamp': '2026-01-10T03:39:09Z', 'spider': 'zomato_integration_check', 'client_id': '2', 'domain': 'www.zomato.com', 'bytes_sent': 0, 'bytes_received': 7650, 'duration_seconds': 219.31, 'host': 'ip-172-31-16-168', 'status': 'finished'}
2026-01-10 03:39:09 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): watchdog.restaverse.com:9200
2026-01-10 03:39:09 [urllib3.connectionpool] DEBUG: http://watchdog.restaverse.com:9200 "POST /scrapy-2026-01-10/_doc HTTP/11" 201 164
2026-01-10 03:39:09 [zomato_integration_check] INFO: Logger Payload: {'run_id': '4947ee27-64b0-48aa-a6bc-df28bccb5db3', 'timestamp': '2026-01-10T03:39:09Z', 'spider': 'zomato_integration_check', 'client_id': '2', 'domain': 'cron.restaverse.com', 'bytes_sent': 618, 'bytes_received': 437, 'duration_seconds': 219.31, 'host': 'ip-172-31-16-168', 'status': 'finished'}
2026-01-10 03:39:09 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): watchdog.restaverse.com:9200
2026-01-10 03:39:09 [urllib3.connectionpool] DEBUG: http://watchdog.restaverse.com:9200 "POST /scrapy-2026-01-10/_doc HTTP/11" 201 164
2026-01-10 03:39:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2026-01-10 03:39:10 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 109
2026-01-10 03:39:10 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'client_id': '2',
 'downloader/request_bytes': 280052,
 'downloader/request_count': 62,
 'downloader/request_method_count/GET': 61,
 'downloader/request_method_count/POST': 1,
 'downloader/response_bytes': 214894,
 'downloader/response_count': 62,
 'downloader/response_status_count/200': 2,
 'downloader/response_status_count/403': 60,
 'elapsed_time_seconds': 219.305838,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 1, 10, 3, 39, 9, 595396, tzinfo=datetime.timezone.utc),
 'httpcompression/response_bytes': 70,
 'httpcompression/response_count': 1,
 'item_scraped_count': 20,
 'items_per_minute': None,
 'log_count/DEBUG': 129,
 'log_count/ERROR': 40,
 'log_count/INFO': 17,
 'memusage/max': 122335232,
 'memusage/startup': 109490176,
 'request_depth_max': 2,
 'response_received_count': 22,
 'responses_per_minute': None,
 'retry/count': 40,
 'retry/max_reached': 20,
 'retry/reason_count/403 Forbidden': 40,
 'scheduler/dequeued': 62,
 'scheduler/dequeued/memory': 62,
 'scheduler/enqueued': 62,
 'scheduler/enqueued/memory': 62,
 'start_time': datetime.datetime(2026, 1, 10, 3, 35, 30, 289558, tzinfo=datetime.timezone.utc)}
2026-01-10 03:39:10 [scrapy.core.engine] INFO: Spider closed (finished)