2026-06-21 04:30:07 [scrapy.utils.log] INFO: Scrapy 2.12.0 started (bot: zomato_dining)
2026-06-21 04:30:07 [scrapy.utils.log] INFO: Versions: lxml 5.3.0.0, libxml2 2.12.9, cssselect 1.2.0, parsel 1.9.1, w3lib 2.2.1, Twisted 24.11.0, Python 3.10.12 (main, Mar  3 2026, 11:56:32) [GCC 11.4.0], pyOpenSSL 24.3.0 (OpenSSL 3.4.0 22 Oct 2024), cryptography 44.0.0, Platform Linux-6.8.0-1044-aws-aarch64-with-glibc2.35
2026-06-21 04:30:07 [dining_transaction_history_zomato] INFO: Dynamic attribute _job = 2_2026-06-21T04_30_02
2026-06-21 04:30:07 [dining_transaction_history_zomato] INFO: Dynamic attribute scheduled_job_id = 8077
2026-06-21 04:30:07 [dining_transaction_history_zomato] INFO: Dynamic attribute SCRAPEOPS_JOB_NAME = 2
2026-06-21 04:30:07 [dining_transaction_history_zomato] INFO: Connected to Redis
2026-06-21 04:30:07 [scrapy.addons] INFO: Enabled addons:
[]
2026-06-21 04:30:07 [py.warnings] WARNING: /home/ubuntu/restaverse_spiders/venv/lib/python3.10/site-packages/scrapy/utils/request.py:120: ScrapyDeprecationWarning: 'REQUEST_FINGERPRINTER_IMPLEMENTATION' is a deprecated setting.
It will be removed in a future version of Scrapy.
  return cls(crawler)

2026-06-21 04:30:07 [asyncio] DEBUG: Using selector: EpollSelector
2026-06-21 04:30:07 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-06-21 04:30:07 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-06-21 04:30:07 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-06-21 04:30:07 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-06-21 04:30:07 [scrapy.extensions.telnet] INFO: Telnet Password: fedc6154f4096d6b
2026-06-21 04:30:07 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.logstats.LogStats',
 'scrapeops_scrapy.extension.ScrapeOpsMonitor']
2026-06-21 04:30:07 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'zomato_dining',
 'CONCURRENT_REQUESTS': 8,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/home/ubuntu/restaverse_spiders/logs/zomato_dining/dining_transaction_history_zomato/2_2026-06-21T04_30_02.log',
 'NEWSPIDER_MODULE': 'zomato_dining.spiders',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'RETRY_HTTP_CODES': [500, 502, 503, 504],
 'RETRY_TIMES': 1,
 'SPIDER_MODULES': ['zomato_dining.spiders'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': 'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, '
               'like Gecko) Chrome/127.0.0.0 Safari/537.36'}
2026-06-21 04:30:07 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Android
2026-06-21 04:30:07 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2026-06-21 04:30:08 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2026-06-21 04:30:08 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2026-06-21 04:30:08 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Sony BDV13, Brand: Sony, Model: BDV13
2026-06-21 04:30:08 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Nintendo DSi, Brand: Nintendo, Model: DSi
2026-06-21 04:30:08 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2026-06-21 04:30:08 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Other
2026-06-21 04:30:08 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: LYF F90M, Brand: LYF, Model: F90M
2026-06-21 04:30:08 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Sony BDV14, Brand: Sony, Model: BDV14
2026-06-21 04:30:08 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: LG Web0S SmartTV, Brand: LG, Model: Web0S SmartTV
2026-06-21 04:30:08 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2026-06-21 04:30:08 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2026-06-21 04:30:08 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2026-06-21 04:30:08 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2026-06-21 04:30:08 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2026-06-21 04:30:08 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2026-06-21 04:30:08 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2026-06-21 04:30:08 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Sony BDV11, Brand: Sony, Model: BDV11
2026-06-21 04:30:08 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2026-06-21 04:30:08 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2026-06-21 04:30:08 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2026-06-21 04:30:09 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2026-06-21 04:30:09 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Nintendo DSi, Brand: Nintendo, Model: DSi
2026-06-21 04:30:09 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: LYF LF-2403N, Brand: LYF, Model: LF-2403N
2026-06-21 04:30:09 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: LYF F90M, Brand: LYF, Model: F90M
2026-06-21 04:30:09 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2026-06-21 04:30:09 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2026-06-21 04:30:09 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Applebot
2026-06-21 04:30:09 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2026-06-21 04:30:09 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Applebot
2026-06-21 04:30:09 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Other
2026-06-21 04:30:09 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Other
2026-06-21 04:30:09 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: PhantomJS
2026-06-21 04:30:09 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: SMTBot
2026-06-21 04:30:10 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: PhantomJS
2026-06-21 04:30:10 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: PhantomJS
2026-06-21 04:30:10 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: WebKit Nightly
2026-06-21 04:30:10 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: PhantomJS
2026-06-21 04:30:10 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2026-06-21 04:30:10 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: PhantomJS
2026-06-21 04:30:10 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: PhantomJS
2026-06-21 04:30:10 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Robot
2026-06-21 04:30:10 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2026-06-21 04:30:10 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Zune
2026-06-21 04:30:10 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'zomato_dining.middlewares.ZomatoCentralRateLimitMiddleware',
 'zomato_dining.middlewares.RedisCacheMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy_user_agents.middlewares.RandomUserAgentMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapeops_scrapy.middleware.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-06-21 04:30:10 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'zomato_dining.middlewares.ZomatoDiningSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-06-21 04:30:10 [scrapy.middleware] INFO: Enabled item pipelines:
['zomato_dining.pipelines.ZomatoDiningPipeline']
2026-06-21 04:30:10 [scrapy.core.engine] INFO: Spider opened
2026-06-21 04:30:10 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-06-21 04:30:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2026-06-21 04:30:11 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/setup/ HTTP/11" 200 None
2026-06-21 04:30:11 [dining_transaction_history_zomato] INFO: Spider opened: dining_transaction_history_zomato
2026-06-21 04:30:11 [scrapy.utils.signal] ERROR: Error caught on signal handler: <bound method TelnetConsole.start_listening of <scrapy.extensions.telnet.TelnetConsole object at 0xf169a7729b40>>
Traceback (most recent call last):
  File "/home/ubuntu/restaverse_spiders/venv/lib/python3.10/site-packages/scrapy/utils/defer.py", line 400, in maybeDeferred_coro
    result = f(*args, **kw)
  File "/home/ubuntu/restaverse_spiders/venv/lib/python3.10/site-packages/pydispatch/robustapply.py", line 55, in robustApply
    return receiver(*arguments, **named)
  File "/home/ubuntu/restaverse_spiders/venv/lib/python3.10/site-packages/scrapy/extensions/telnet.py", line 67, in start_listening
    self.port: Port = listen_tcp(self.portrange, self.host, self)
  File "/home/ubuntu/restaverse_spiders/venv/lib/python3.10/site-packages/scrapy/utils/reactor.py", line 41, in listen_tcp
    return reactor.listenTCP(x, factory, interface=host)
  File "/home/ubuntu/restaverse_spiders/venv/lib/python3.10/site-packages/twisted/internet/posixbase.py", line 366, in listenTCP
    p.startListening()
  File "/home/ubuntu/restaverse_spiders/venv/lib/python3.10/site-packages/twisted/internet/tcp.py", line 1361, in startListening
    skt.listen(self.backlog)
OSError: [Errno 98] Address already in use
2026-06-21 04:30:11 [dining_transaction_history_zomato] INFO: No Redis session found for client_id=2, falling back to DB
2026-06-21 04:30:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): cron.restaverse.com:443
2026-06-21 04:30:11 [urllib3.connectionpool] DEBUG: https://cron.restaverse.com:443 "POST /api/db_services/fetch-query HTTP/11" 200 3348
2026-06-21 04:30:11 [scrapy_user_agents.middlewares] DEBUG: Proxy is detected http://scrapeops.country=in:dbc08e8a-4f73-4088-9f13-c2db0a774557@residential-proxy.scrapeops.io:8181
2026-06-21 04:30:11 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.115 Safari/537.36
2026-06-21 04:30:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2026-06-21 04:30:12 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/normalizer/proxy_port/?job_id=7099030 HTTP/11" 200 None
2026-06-21 04:30:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2026-06-21 04:30:12 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/normalizer/domain/?domain=zomato.com HTTP/11" 200 241
2026-06-21 04:30:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.zomato.com/webroutes/auth/csrf?service_type=dine_out> (referer: https://www.zomato.com/)
2026-06-21 04:30:15 [scrapy_user_agents.middlewares] DEBUG: Proxy is detected http://scrapeops.country=in:dbc08e8a-4f73-4088-9f13-c2db0a774557@residential-proxy.scrapeops.io:8181
2026-06-21 04:30:15 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.115 Safari/537.36
2026-06-21 04:30:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/dining-gw/csrf/get?service_type=dine_out> (referer: https://www.zomato.com/webroutes/auth/csrf?service_type=dine_out)
2026-06-21 04:30:21 [dining_transaction_history_zomato] INFO: [CACHE KEY GENERATED] https://api.zomato.com/dining-gw/merchant/web/restaurants/get-all?page=1&service_type=dine_out
2026-06-21 04:30:21 [scrapy_user_agents.middlewares] DEBUG: Proxy is detected http://scrapeops.country=in:dbc08e8a-4f73-4088-9f13-c2db0a774557@residential-proxy.scrapeops.io:8181
2026-06-21 04:30:21 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.115 Safari/537.36
2026-06-21 04:30:23 [dining_transaction_history_zomato] INFO: [CACHE KEY GENERATED] https://api.zomato.com/dining-gw/merchant/web/restaurants/get-all?page=1&service_type=dine_out
2026-06-21 04:30:23 [dining_transaction_history_zomato] INFO: [CACHE STORE] https://api.zomato.com/dining-gw/merchant/web/restaurants/get-all?page=1&service_type=dine_out
2026-06-21 04:30:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/dining-gw/merchant/web/restaurants/get-all?page=1&service_type=dine_out> (referer: https://api.zomato.com/dining-gw/csrf/get?service_type=dine_out)
2026-06-21 04:30:23 [dining_transaction_history_zomato] INFO: [CACHE KEY GENERATED] https://api.zomato.com/dining-gw/merchant/web/restaurants/get-all?page=2&service_type=dine_out
2026-06-21 04:30:23 [scrapy_user_agents.middlewares] DEBUG: Proxy is detected http://scrapeops.country=in:dbc08e8a-4f73-4088-9f13-c2db0a774557@residential-proxy.scrapeops.io:8181
2026-06-21 04:30:23 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.115 Safari/537.36
2026-06-21 04:30:24 [dining_transaction_history_zomato] INFO: [CACHE KEY GENERATED] https://api.zomato.com/dining-gw/merchant/web/restaurants/get-all?page=2&service_type=dine_out
2026-06-21 04:30:24 [dining_transaction_history_zomato] INFO: [CACHE STORE] https://api.zomato.com/dining-gw/merchant/web/restaurants/get-all?page=2&service_type=dine_out
2026-06-21 04:30:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/dining-gw/merchant/web/restaurants/get-all?page=2&service_type=dine_out> (referer: https://api.zomato.com/dining-gw/merchant/web/restaurants/get-all?page=1&service_type=dine_out)
2026-06-21 04:30:24 [dining_transaction_history_zomato] INFO: [CACHE KEY GENERATED] https://api.zomato.com/dining-gw/merchant/web/restaurants/get-all?page=3&service_type=dine_out
2026-06-21 04:30:24 [scrapy_user_agents.middlewares] DEBUG: Proxy is detected http://scrapeops.country=in:dbc08e8a-4f73-4088-9f13-c2db0a774557@residential-proxy.scrapeops.io:8181
2026-06-21 04:30:24 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.115 Safari/537.36
2026-06-21 04:30:25 [dining_transaction_history_zomato] INFO: [CACHE KEY GENERATED] https://api.zomato.com/dining-gw/merchant/web/restaurants/get-all?page=3&service_type=dine_out
2026-06-21 04:30:25 [dining_transaction_history_zomato] INFO: [CACHE STORE] https://api.zomato.com/dining-gw/merchant/web/restaurants/get-all?page=3&service_type=dine_out
2026-06-21 04:30:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/dining-gw/merchant/web/restaurants/get-all?page=3&service_type=dine_out> (referer: https://api.zomato.com/dining-gw/merchant/web/restaurants/get-all?page=2&service_type=dine_out)
2026-06-21 04:30:25 [dining_transaction_history_zomato] INFO: [CACHE KEY GENERATED] https://api.zomato.com/dining-gw/merchant/web/restaurants/get-all?page=4&service_type=dine_out
2026-06-21 04:30:25 [scrapy_user_agents.middlewares] DEBUG: Proxy is detected http://scrapeops.country=in:dbc08e8a-4f73-4088-9f13-c2db0a774557@residential-proxy.scrapeops.io:8181
2026-06-21 04:30:25 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.115 Safari/537.36
2026-06-21 04:30:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2026-06-21 04:30:26 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 109
2026-06-21 04:30:26 [dining_transaction_history_zomato] INFO: [CACHE KEY GENERATED] https://api.zomato.com/dining-gw/merchant/web/restaurants/get-all?page=4&service_type=dine_out
2026-06-21 04:30:26 [dining_transaction_history_zomato] INFO: [CACHE STORE] https://api.zomato.com/dining-gw/merchant/web/restaurants/get-all?page=4&service_type=dine_out
2026-06-21 04:30:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/dining-gw/merchant/web/restaurants/get-all?page=4&service_type=dine_out> (referer: https://api.zomato.com/dining-gw/merchant/web/restaurants/get-all?page=3&service_type=dine_out)
2026-06-21 04:30:26 [dining_transaction_history_zomato] INFO: [CACHE KEY GENERATED] https://api.zomato.com/dining-gw/merchant/web/restaurants/get-all?page=5&service_type=dine_out
2026-06-21 04:30:26 [scrapy_user_agents.middlewares] DEBUG: Proxy is detected http://scrapeops.country=in:dbc08e8a-4f73-4088-9f13-c2db0a774557@residential-proxy.scrapeops.io:8181
2026-06-21 04:30:26 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.115 Safari/537.36
2026-06-21 04:30:27 [dining_transaction_history_zomato] INFO: [CACHE KEY GENERATED] https://api.zomato.com/dining-gw/merchant/web/restaurants/get-all?page=5&service_type=dine_out
2026-06-21 04:30:27 [dining_transaction_history_zomato] INFO: [CACHE STORE] https://api.zomato.com/dining-gw/merchant/web/restaurants/get-all?page=5&service_type=dine_out
2026-06-21 04:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/dining-gw/merchant/web/restaurants/get-all?page=5&service_type=dine_out> (referer: https://api.zomato.com/dining-gw/merchant/web/restaurants/get-all?page=4&service_type=dine_out)
2026-06-21 04:30:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): cron.restaverse.com:443
2026-06-21 04:30:27 [urllib3.connectionpool] DEBUG: https://cron.restaverse.com:443 "POST /api/db_services/fetch-query HTTP/11" 200 87
2026-06-21 04:30:27 [scrapy_user_agents.middlewares] DEBUG: Proxy is detected http://scrapeops.country=in:dbc08e8a-4f73-4088-9f13-c2db0a774557@residential-proxy.scrapeops.io:8181
2026-06-21 04:30:27 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.115 Safari/537.36
2026-06-21 04:30:28 [scrapy_user_agents.middlewares] DEBUG: Proxy is detected http://scrapeops.country=in:dbc08e8a-4f73-4088-9f13-c2db0a774557@residential-proxy.scrapeops.io:8181
2026-06-21 04:30:28 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.115 Safari/537.36
2026-06-21 04:30:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/dining-gw/merchant/web/transactions/history?select=transactions&res_id=311675&start_date=2026-06-20&end_date=2026-06-20&offset=0&limit=10&activeTabId=transactions&service_type=dine_out> (referer: https://api.zomato.com/dining-gw/merchant/web/restaurants/get-all?page=5&service_type=dine_out)
2026-06-21 04:30:28 [scrapy_user_agents.middlewares] DEBUG: Proxy is detected http://scrapeops.country=in:dbc08e8a-4f73-4088-9f13-c2db0a774557@residential-proxy.scrapeops.io:8181
2026-06-21 04:30:28 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.115 Safari/537.36
2026-06-21 04:30:29 [scrapy_user_agents.middlewares] DEBUG: Proxy is detected http://scrapeops.country=in:dbc08e8a-4f73-4088-9f13-c2db0a774557@residential-proxy.scrapeops.io:8181
2026-06-21 04:30:29 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.115 Safari/537.36
2026-06-21 04:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/dining-gw/merchant/web/transactions/history?select=transactions&res_id=21553792&start_date=2026-06-20&end_date=2026-06-20&offset=0&limit=10&activeTabId=transactions&service_type=dine_out> (referer: https://api.zomato.com/dining-gw/merchant/web/restaurants/get-all?page=5&service_type=dine_out)
2026-06-21 04:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/dining-gw/merchant/web/transactions/history?select=transactions&res_id=21659582&start_date=2026-06-20&end_date=2026-06-20&offset=0&limit=10&activeTabId=transactions&service_type=dine_out> (referer: https://api.zomato.com/dining-gw/merchant/web/restaurants/get-all?page=5&service_type=dine_out)
2026-06-21 04:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/dining-gw/merchant/web/transactions/history?select=transactions&res_id=21659582&start_date=2026-06-20&end_date=2026-06-20&offset=0&limit=10&activeTabId=transactions&service_type=dine_out>
{'bill_amount': '2854',
 'confirmation_code': 8325,
 'created_by': 'Dhanur Dhar Singh Rana',
 'payment_info': '[{"type": "bill_amount", "label": "Bill amount", "value": '
                 '"\\u20b92,854"}, {"type": "discount", "label": "Total '
                 'discount", "value": ""}, {"type": "tip_amount", "label": '
                 '"Tips", "value": ""}, {"type": "user_paid_amount", "label": '
                 '"Paid amount", "value": "\\u20b92,854"}]',
 'payout_info': '[{"type": "gross_revenue_a", "label": "Gross revenue after '
                'discounts (A)", "value": "\\u20b92,854"}, {"type": '
                '"additions_b", "label": "Additions (B)", "value": "", '
                '"items": [{"type": "tip", "label": "Tip for the staff", '
                '"value": ""}]}, {"type": "deductions_b", "label": "Deductions '
                '(C)", "value": "\\u20b9101.03", "items": [{"type": '
                '"commission", "label": "Commission", "value": '
                '"-\\u20b985.62"}, {"type": "tax_on_commission", "label": "Tax '
                'on commission", "value": "-\\u20b915.41"}]}, {"type": '
                '"net_receivable", "label": "Net receivable (A+B-C)", "value": '
                '"\\u20b92,752.97"}]',
 'payout_settlement_date': '2026-06-22',
 'payout_status': 'pending',
 'rating': None,
 'res_id': 21659582,
 'settlement_amount': '2752.97',
 'status': 'success',
 'timestamp': '2026-06-20T17:28:00+00:00',
 'transaction_id': 5100478633,
 'user_paid_amount': '2854'}
2026-06-21 04:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/dining-gw/merchant/web/transactions/history?select=transactions&res_id=21659582&start_date=2026-06-20&end_date=2026-06-20&offset=0&limit=10&activeTabId=transactions&service_type=dine_out>
{'bill_amount': '2854',
 'confirmation_code': 9098,
 'created_by': 'Dhanur Dhar Singh Rana',
 'payment_info': '[{"type": "bill_amount", "label": "Bill amount", "value": '
                 '"\\u20b92,854"}, {"type": "discount", "label": "Total '
                 'discount", "value": ""}, {"type": "tip_amount", "label": '
                 '"Tips", "value": ""}, {"type": "user_paid_amount", "label": '
                 '"Paid amount", "value": "\\u20b92,854"}]',
 'payout_info': 'null',
 'payout_settlement_date': None,
 'payout_status': None,
 'rating': None,
 'res_id': 21659582,
 'settlement_amount': 'None',
 'status': 'failed',
 'timestamp': '2026-06-20T17:27:00+00:00',
 'transaction_id': 3117068661,
 'user_paid_amount': '2854'}
2026-06-21 04:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/dining-gw/merchant/web/transactions/history?select=transactions&res_id=21659582&start_date=2026-06-20&end_date=2026-06-20&offset=0&limit=10&activeTabId=transactions&service_type=dine_out>
{'bill_amount': '1784',
 'confirmation_code': 3383,
 'created_by': 'Piyashree Dutta',
 'payment_info': '[{"type": "bill_amount", "label": "Bill amount", "value": '
                 '"\\u20b91,784"}, {"type": "discount", "label": "Total '
                 'discount", "value": ""}, {"type": "tip_amount", "label": '
                 '"Tips", "value": ""}, {"type": "user_paid_amount", "label": '
                 '"Paid amount", "value": "\\u20b91,784"}]',
 'payout_info': '[{"type": "gross_revenue_a", "label": "Gross revenue after '
                'discounts (A)", "value": "\\u20b91,784"}, {"type": '
                '"additions_b", "label": "Additions (B)", "value": "", '
                '"items": [{"type": "tip", "label": "Tip for the staff", '
                '"value": ""}]}, {"type": "deductions_b", "label": "Deductions '
                '(C)", "value": "\\u20b963.15", "items": [{"type": '
                '"commission", "label": "Commission", "value": '
                '"-\\u20b953.52"}, {"type": "tax_on_commission", "label": "Tax '
                'on commission", "value": "-\\u20b99.63"}]}, {"type": '
                '"net_receivable", "label": "Net receivable (A+B-C)", "value": '
                '"\\u20b91,720.85"}]',
 'payout_settlement_date': '2026-06-22',
 'payout_status': 'pending',
 'rating': None,
 'res_id': 21659582,
 'settlement_amount': '1720.85',
 'status': 'success',
 'timestamp': '2026-06-20T17:13:00+00:00',
 'transaction_id': 9810471278,
 'user_paid_amount': '1784'}
2026-06-21 04:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/dining-gw/merchant/web/transactions/history?select=transactions&res_id=21659582&start_date=2026-06-20&end_date=2026-06-20&offset=0&limit=10&activeTabId=transactions&service_type=dine_out>
{'bill_amount': '3157',
 'confirmation_code': 1982,
 'created_by': 'Ishu',
 'payment_info': '[{"type": "bill_amount", "label": "Bill amount", "value": '
                 '"\\u20b93,157"}, {"type": "discount", "label": "Total '
                 'discount", "value": ""}, {"type": "tip_amount", "label": '
                 '"Tips", "value": ""}, {"type": "user_paid_amount", "label": '
                 '"Paid amount", "value": "\\u20b93,157"}]',
 'payout_info': '[{"type": "gross_revenue_a", "label": "Gross revenue after '
                'discounts (A)", "value": "\\u20b93,157"}, {"type": '
                '"additions_b", "label": "Additions (B)", "value": "", '
                '"items": [{"type": "tip", "label": "Tip for the staff", '
                '"value": ""}]}, {"type": "deductions_b", "label": "Deductions '
                '(C)", "value": "\\u20b9111.76", "items": [{"type": '
                '"commission", "label": "Commission", "value": '
                '"-\\u20b994.71"}, {"type": "tax_on_commission", "label": "Tax '
                'on commission", "value": "-\\u20b917.05"}]}, {"type": '
                '"net_receivable", "label": "Net receivable (A+B-C)", "value": '
                '"\\u20b93,045.24"}]',
 'payout_settlement_date': '2026-06-22',
 'payout_status': 'pending',
 'rating': '5',
 'res_id': 21659582,
 'settlement_amount': '3045.24',
 'status': 'success',
 'timestamp': '2026-06-20T16:52:00+00:00',
 'transaction_id': 12260189,
 'user_paid_amount': '3157'}
2026-06-21 04:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/dining-gw/merchant/web/transactions/history?select=transactions&res_id=21659582&start_date=2026-06-20&end_date=2026-06-20&offset=0&limit=10&activeTabId=transactions&service_type=dine_out>
{'bill_amount': '2435',
 'confirmation_code': 6323,
 'created_by': 'Pratishtha',
 'payment_info': '[{"type": "bill_amount", "label": "Bill amount", "value": '
                 '"\\u20b92,435"}, {"type": "discount", "label": "Total '
                 'discount", "value": "\\u20b9365.25", "items": [{"type": '
                 '"user_salt_discount", "label": "Pre-book discount", "value": '
                 '"\\u20b9365.25"}]}, {"type": "tip_amount", "label": "Tips", '
                 '"value": ""}, {"type": "user_paid_amount", "label": "Paid '
                 'amount", "value": "\\u20b92,069.75"}]',
 'payout_info': '[{"type": "gross_revenue_a", "label": "Gross revenue after '
                'discounts (A)", "value": "\\u20b92,069.75"}, {"type": '
                '"additions_b", "label": "Additions (B)", "value": "", '
                '"items": [{"type": "tip", "label": "Tip for the staff", '
                '"value": ""}]}, {"type": "deductions_b", "label": "Deductions '
                '(C)", "value": "\\u20b973.27", "items": [{"type": '
                '"commission", "label": "Commission", "value": '
                '"-\\u20b962.09"}, {"type": "tax_on_commission", "label": "Tax '
                'on commission", "value": "-\\u20b911.18"}]}, {"type": '
                '"net_receivable", "label": "Net receivable (A+B-C)", "value": '
                '"\\u20b91,996.48"}]',
 'payout_settlement_date': '2026-06-22',
 'payout_status': 'pending',
 'rating': None,
 'res_id': 21659582,
 'settlement_amount': '1996.48',
 'status': 'success',
 'timestamp': '2026-06-20T16:45:00+00:00',
 'transaction_id': 7955713557,
 'user_paid_amount': '2069.75'}
2026-06-21 04:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/dining-gw/merchant/web/transactions/history?select=transactions&res_id=21659582&start_date=2026-06-20&end_date=2026-06-20&offset=0&limit=10&activeTabId=transactions&service_type=dine_out>
{'bill_amount': '629',
 'confirmation_code': 6555,
 'created_by': 'Heena Aggarwal',
 'payment_info': '[{"type": "bill_amount", "label": "Bill amount", "value": '
                 '"\\u20b9629"}, {"type": "discount", "label": "Total '
                 'discount", "value": ""}, {"type": "tip_amount", "label": '
                 '"Tips", "value": ""}, {"type": "user_paid_amount", "label": '
                 '"Paid amount", "value": "\\u20b9629"}]',
 'payout_info': '[{"type": "gross_revenue_a", "label": "Gross revenue after '
                'discounts (A)", "value": "\\u20b9629"}, {"type": '
                '"additions_b", "label": "Additions (B)", "value": "", '
                '"items": [{"type": "tip", "label": "Tip for the staff", '
                '"value": ""}]}, {"type": "deductions_b", "label": "Deductions '
                '(C)", "value": "\\u20b922.27", "items": [{"type": '
                '"commission", "label": "Commission", "value": '
                '"-\\u20b918.87"}, {"type": "tax_on_commission", "label": "Tax '
                'on commission", "value": "-\\u20b93.4"}]}, {"type": '
                '"net_receivable", "label": "Net receivable (A+B-C)", "value": '
                '"\\u20b9606.73"}]',
 'payout_settlement_date': '2026-06-22',
 'payout_status': 'pending',
 'rating': '5',
 'res_id': 21659582,
 'settlement_amount': '606.73',
 'status': 'success',
 'timestamp': '2026-06-20T16:02:00+00:00',
 'transaction_id': 3949505780,
 'user_paid_amount': '629'}
2026-06-21 04:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/dining-gw/merchant/web/transactions/history?select=transactions&res_id=21659582&start_date=2026-06-20&end_date=2026-06-20&offset=0&limit=10&activeTabId=transactions&service_type=dine_out>
{'bill_amount': '629',
 'confirmation_code': 7998,
 'created_by': 'Heena Aggarwal',
 'payment_info': '[{"type": "bill_amount", "label": "Bill amount", "value": '
                 '"\\u20b9629"}, {"type": "discount", "label": "Total '
                 'discount", "value": ""}, {"type": "tip_amount", "label": '
                 '"Tips", "value": ""}, {"type": "user_paid_amount", "label": '
                 '"Paid amount", "value": "\\u20b9629"}]',
 'payout_info': 'null',
 'payout_settlement_date': None,
 'payout_status': None,
 'rating': None,
 'res_id': 21659582,
 'settlement_amount': 'None',
 'status': 'failed',
 'timestamp': '2026-06-20T16:01:00+00:00',
 'transaction_id': 6150415209,
 'user_paid_amount': '629'}
2026-06-21 04:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/dining-gw/merchant/web/transactions/history?select=transactions&res_id=21659582&start_date=2026-06-20&end_date=2026-06-20&offset=0&limit=10&activeTabId=transactions&service_type=dine_out>
{'bill_amount': '921',
 'confirmation_code': 8999,
 'created_by': 'Rajendra',
 'payment_info': '[{"type": "bill_amount", "label": "Bill amount", "value": '
                 '"\\u20b9921"}, {"type": "discount", "label": "Total '
                 'discount", "value": "\\u20b9138.15", "items": [{"type": '
                 '"user_salt_discount", "label": "Pre-book discount", "value": '
                 '"\\u20b9138.15"}]}, {"type": "tip_amount", "label": "Tips", '
                 '"value": ""}, {"type": "user_paid_amount", "label": "Paid '
                 'amount", "value": "\\u20b9782.85"}]',
 'payout_info': '[{"type": "gross_revenue_a", "label": "Gross revenue after '
                'discounts (A)", "value": "\\u20b9782.85"}, {"type": '
                '"additions_b", "label": "Additions (B)", "value": "", '
                '"items": [{"type": "tip", "label": "Tip for the staff", '
                '"value": ""}]}, {"type": "deductions_b", "label": "Deductions '
                '(C)", "value": "\\u20b927.72", "items": [{"type": '
                '"commission", "label": "Commission", "value": '
                '"-\\u20b923.49"}, {"type": "tax_on_commission", "label": "Tax '
                'on commission", "value": "-\\u20b94.23"}]}, {"type": '
                '"net_receivable", "label": "Net receivable (A+B-C)", "value": '
                '"\\u20b9755.13"}]',
 'payout_settlement_date': '2026-06-22',
 'payout_status': 'pending',
 'rating': None,
 'res_id': 21659582,
 'settlement_amount': '755.13',
 'status': 'success',
 'timestamp': '2026-06-20T14:57:00+00:00',
 'transaction_id': 2469442519,
 'user_paid_amount': '782.85'}
2026-06-21 04:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/dining-gw/merchant/web/transactions/history?select=transactions&res_id=21659582&start_date=2026-06-20&end_date=2026-06-20&offset=0&limit=10&activeTabId=transactions&service_type=dine_out>
{'bill_amount': '2426',
 'confirmation_code': 5995,
 'created_by': 'Ad.',
 'payment_info': '[{"type": "bill_amount", "label": "Bill amount", "value": '
                 '"\\u20b92,426"}, {"type": "discount", "label": "Total '
                 'discount", "value": ""}, {"type": "tip_amount", "label": '
                 '"Tips", "value": ""}, {"type": "user_paid_amount", "label": '
                 '"Paid amount", "value": "\\u20b92,426"}]',
 'payout_info': '[{"type": "gross_revenue_a", "label": "Gross revenue after '
                'discounts (A)", "value": "\\u20b92,426"}, {"type": '
                '"additions_b", "label": "Additions (B)", "value": "", '
                '"items": [{"type": "tip", "label": "Tip for the staff", '
                '"value": ""}]}, {"type": "deductions_b", "label": "Deductions '
                '(C)", "value": "\\u20b985.88", "items": [{"type": '
                '"commission", "label": "Commission", "value": '
                '"-\\u20b972.78"}, {"type": "tax_on_commission", "label": "Tax '
                'on commission", "value": "-\\u20b913.1"}]}, {"type": '
                '"net_receivable", "label": "Net receivable (A+B-C)", "value": '
                '"\\u20b92,340.12"}]',
 'payout_settlement_date': '2026-06-22',
 'payout_status': 'pending',
 'rating': None,
 'res_id': 21659582,
 'settlement_amount': '2340.12',
 'status': 'success',
 'timestamp': '2026-06-20T14:25:00+00:00',
 'transaction_id': 3206505782,
 'user_paid_amount': '2426'}
2026-06-21 04:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/dining-gw/merchant/web/transactions/history?select=transactions&res_id=21659582&start_date=2026-06-20&end_date=2026-06-20&offset=0&limit=10&activeTabId=transactions&service_type=dine_out>
{'bill_amount': '3734',
 'confirmation_code': 1011,
 'created_by': 'Sudeshna Dam',
 'payment_info': '[{"type": "bill_amount", "label": "Bill amount", "value": '
                 '"\\u20b93,734"}, {"type": "discount", "label": "Total '
                 'discount", "value": ""}, {"type": "tip_amount", "label": '
                 '"Tips", "value": ""}, {"type": "user_paid_amount", "label": '
                 '"Paid amount", "value": "\\u20b93,734"}]',
 'payout_info': '[{"type": "gross_revenue_a", "label": "Gross revenue after '
                'discounts (A)", "value": "\\u20b93,734"}, {"type": '
                '"additions_b", "label": "Additions (B)", "value": "", '
                '"items": [{"type": "tip", "label": "Tip for the staff", '
                '"value": ""}]}, {"type": "deductions_b", "label": "Deductions '
                '(C)", "value": "\\u20b9132.18", "items": [{"type": '
                '"commission", "label": "Commission", "value": '
                '"-\\u20b9112.02"}, {"type": "tax_on_commission", "label": '
                '"Tax on commission", "value": "-\\u20b920.16"}]}, {"type": '
                '"net_receivable", "label": "Net receivable (A+B-C)", "value": '
                '"\\u20b93,601.82"}]',
 'payout_settlement_date': '2026-06-22',
 'payout_status': 'pending',
 'rating': '5',
 'res_id': 21659582,
 'settlement_amount': '3601.82',
 'status': 'success',
 'timestamp': '2026-06-20T11:34:00+00:00',
 'transaction_id': 5582703664,
 'user_paid_amount': '3734'}
2026-06-21 04:30:31 [scrapy_user_agents.middlewares] DEBUG: Proxy is detected http://scrapeops.country=in:dbc08e8a-4f73-4088-9f13-c2db0a774557@residential-proxy.scrapeops.io:8181
2026-06-21 04:30:31 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.115 Safari/537.36
2026-06-21 04:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/dining-gw/merchant/web/transactions/history?select=transactions&res_id=18565268&start_date=2026-06-20&end_date=2026-06-20&offset=0&limit=10&activeTabId=transactions&service_type=dine_out> (referer: https://api.zomato.com/dining-gw/merchant/web/restaurants/get-all?page=5&service_type=dine_out)
2026-06-21 04:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/dining-gw/merchant/web/transactions/history?select=transactions&res_id=21659582&start_date=2026-06-20&end_date=2026-06-20&offset=10&limit=10&activeTabId=transactions&service_type=dine_out> (referer: https://api.zomato.com/dining-gw/merchant/web/transactions/history?select=transactions&res_id=21659582&start_date=2026-06-20&end_date=2026-06-20&offset=0&limit=10&activeTabId=transactions&service_type=dine_out)
2026-06-21 04:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/dining-gw/merchant/web/transactions/history?select=transactions&res_id=21659582&start_date=2026-06-20&end_date=2026-06-20&offset=10&limit=10&activeTabId=transactions&service_type=dine_out>
{'bill_amount': '4261',
 'confirmation_code': 7967,
 'created_by': 'Arjun Mukherjee',
 'payment_info': '[{"type": "bill_amount", "label": "Bill amount", "value": '
                 '"\\u20b94,261"}, {"type": "discount", "label": "Total '
                 'discount", "value": "\\u20b9639.15", "items": [{"type": '
                 '"user_salt_discount", "label": "Pre-book discount", "value": '
                 '"\\u20b9639.15"}]}, {"type": "tip_amount", "label": "Tips", '
                 '"value": ""}, {"type": "user_paid_amount", "label": "Paid '
                 'amount", "value": "\\u20b93,621.85"}]',
 'payout_info': '[{"type": "gross_revenue_a", "label": "Gross revenue after '
                'discounts (A)", "value": "\\u20b93,621.85"}, {"type": '
                '"additions_b", "label": "Additions (B)", "value": "", '
                '"items": [{"type": "tip", "label": "Tip for the staff", '
                '"value": ""}]}, {"type": "deductions_b", "label": "Deductions '
                '(C)", "value": "\\u20b9128.22", "items": [{"type": '
                '"commission", "label": "Commission", "value": '
                '"-\\u20b9108.66"}, {"type": "tax_on_commission", "label": '
                '"Tax on commission", "value": "-\\u20b919.56"}]}, {"type": '
                '"net_receivable", "label": "Net receivable (A+B-C)", "value": '
                '"\\u20b93,493.63"}]',
 'payout_settlement_date': '2026-06-22',
 'payout_status': 'pending',
 'rating': '5',
 'res_id': 21659582,
 'settlement_amount': '3493.63',
 'status': 'success',
 'timestamp': '2026-06-20T11:33:00+00:00',
 'transaction_id': 4977359699,
 'user_paid_amount': '3621.85'}
2026-06-21 04:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/dining-gw/merchant/web/transactions/history?select=transactions&res_id=21659582&start_date=2026-06-20&end_date=2026-06-20&offset=10&limit=10&activeTabId=transactions&service_type=dine_out>
{'bill_amount': '4952',
 'confirmation_code': 9771,
 'created_by': 'Himanshu',
 'payment_info': '[{"type": "bill_amount", "label": "Bill amount", "value": '
                 '"\\u20b94,952"}, {"type": "discount", "label": "Total '
                 'discount", "value": "\\u20b9742.8", "items": [{"type": '
                 '"user_salt_discount", "label": "Pre-book discount", "value": '
                 '"\\u20b9742.8"}]}, {"type": "tip_amount", "label": "Tips", '
                 '"value": ""}, {"type": "user_paid_amount", "label": "Paid '
                 'amount", "value": "\\u20b94,209.2"}]',
 'payout_info': '[{"type": "gross_revenue_a", "label": "Gross revenue after '
                'discounts (A)", "value": "\\u20b94,209.2"}, {"type": '
                '"additions_b", "label": "Additions (B)", "value": "", '
                '"items": [{"type": "tip", "label": "Tip for the staff", '
                '"value": ""}]}, {"type": "deductions_b", "label": "Deductions '
                '(C)", "value": "\\u20b9149.01", "items": [{"type": '
                '"commission", "label": "Commission", "value": '
                '"-\\u20b9126.28"}, {"type": "tax_on_commission", "label": '
                '"Tax on commission", "value": "-\\u20b922.73"}]}, {"type": '
                '"net_receivable", "label": "Net receivable (A+B-C)", "value": '
                '"\\u20b94,060.19"}]',
 'payout_settlement_date': '2026-06-22',
 'payout_status': 'pending',
 'rating': '5',
 'res_id': 21659582,
 'settlement_amount': '4060.19',
 'status': 'success',
 'timestamp': '2026-06-20T10:46:00+00:00',
 'transaction_id': 9681722005,
 'user_paid_amount': '4209.2'}
2026-06-21 04:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/dining-gw/merchant/web/transactions/history?select=transactions&res_id=21659582&start_date=2026-06-20&end_date=2026-06-20&offset=10&limit=10&activeTabId=transactions&service_type=dine_out>
{'bill_amount': '1406',
 'confirmation_code': 2252,
 'created_by': 'Akshit',
 'payment_info': '[{"type": "bill_amount", "label": "Bill amount", "value": '
                 '"\\u20b91,406"}, {"type": "discount", "label": "Total '
                 'discount", "value": "\\u20b9210.9", "items": [{"type": '
                 '"user_salt_discount", "label": "Pre-book discount", "value": '
                 '"\\u20b9210.9"}]}, {"type": "tip_amount", "label": "Tips", '
                 '"value": ""}, {"type": "user_paid_amount", "label": "Paid '
                 'amount", "value": "\\u20b91,195.1"}]',
 'payout_info': '[{"type": "gross_revenue_a", "label": "Gross revenue after '
                'discounts (A)", "value": "\\u20b91,195.1"}, {"type": '
                '"additions_b", "label": "Additions (B)", "value": "", '
                '"items": [{"type": "tip", "label": "Tip for the staff", '
                '"value": ""}]}, {"type": "deductions_b", "label": "Deductions '
                '(C)", "value": "\\u20b942.3", "items": [{"type": '
                '"commission", "label": "Commission", "value": '
                '"-\\u20b935.85"}, {"type": "tax_on_commission", "label": "Tax '
                'on commission", "value": "-\\u20b96.45"}]}, {"type": '
                '"net_receivable", "label": "Net receivable (A+B-C)", "value": '
                '"\\u20b91,152.8"}]',
 'payout_settlement_date': '2026-06-22',
 'payout_status': 'pending',
 'rating': None,
 'res_id': 21659582,
 'settlement_amount': '1152.8',
 'status': 'success',
 'timestamp': '2026-06-20T10:17:00+00:00',
 'transaction_id': 7538890615,
 'user_paid_amount': '1195.1'}
2026-06-21 04:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/dining-gw/merchant/web/transactions/history?select=transactions&res_id=21659582&start_date=2026-06-20&end_date=2026-06-20&offset=10&limit=10&activeTabId=transactions&service_type=dine_out>
{'bill_amount': '882',
 'confirmation_code': 4240,
 'created_by': 'User',
 'payment_info': '[{"type": "bill_amount", "label": "Bill amount", "value": '
                 '"\\u20b9882"}, {"type": "discount", "label": "Total '
                 'discount", "value": ""}, {"type": "tip_amount", "label": '
                 '"Tips", "value": ""}, {"type": "user_paid_amount", "label": '
                 '"Paid amount", "value": "\\u20b9882"}]',
 'payout_info': '[{"type": "gross_revenue_a", "label": "Gross revenue after '
                'discounts (A)", "value": "\\u20b9882"}, {"type": '
                '"additions_b", "label": "Additions (B)", "value": "", '
                '"items": [{"type": "tip", "label": "Tip for the staff", '
                '"value": ""}]}, {"type": "deductions_b", "label": "Deductions '
                '(C)", "value": "\\u20b931.22", "items": [{"type": '
                '"commission", "label": "Commission", "value": '
                '"-\\u20b926.46"}, {"type": "tax_on_commission", "label": "Tax '
                'on commission", "value": "-\\u20b94.76"}]}, {"type": '
                '"net_receivable", "label": "Net receivable (A+B-C)", "value": '
                '"\\u20b9850.78"}]',
 'payout_settlement_date': '2026-06-22',
 'payout_status': 'pending',
 'rating': None,
 'res_id': 21659582,
 'settlement_amount': '850.78',
 'status': 'success',
 'timestamp': '2026-06-20T10:14:00+00:00',
 'transaction_id': 9918510617,
 'user_paid_amount': '882'}
2026-06-21 04:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/dining-gw/merchant/web/transactions/history?select=transactions&res_id=21659582&start_date=2026-06-20&end_date=2026-06-20&offset=10&limit=10&activeTabId=transactions&service_type=dine_out>
{'bill_amount': '1365',
 'confirmation_code': 3376,
 'created_by': 'Dev Rohilla',
 'payment_info': '[{"type": "bill_amount", "label": "Bill amount", "value": '
                 '"\\u20b91,365"}, {"type": "discount", "label": "Total '
                 'discount", "value": ""}, {"type": "tip_amount", "label": '
                 '"Tips", "value": ""}, {"type": "user_paid_amount", "label": '
                 '"Paid amount", "value": "\\u20b91,365"}]',
 'payout_info': '[{"type": "gross_revenue_a", "label": "Gross revenue after '
                'discounts (A)", "value": "\\u20b91,365"}, {"type": '
                '"additions_b", "label": "Additions (B)", "value": "", '
                '"items": [{"type": "tip", "label": "Tip for the staff", '
                '"value": ""}]}, {"type": "deductions_b", "label": "Deductions '
                '(C)", "value": "\\u20b948.32", "items": [{"type": '
                '"commission", "label": "Commission", "value": '
                '"-\\u20b940.95"}, {"type": "tax_on_commission", "label": "Tax '
                'on commission", "value": "-\\u20b97.37"}]}, {"type": '
                '"net_receivable", "label": "Net receivable (A+B-C)", "value": '
                '"\\u20b91,316.68"}]',
 'payout_settlement_date': '2026-06-22',
 'payout_status': 'pending',
 'rating': None,
 'res_id': 21659582,
 'settlement_amount': '1316.68',
 'status': 'success',
 'timestamp': '2026-06-20T10:12:00+00:00',
 'transaction_id': 3306842689,
 'user_paid_amount': '1365'}
2026-06-21 04:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/dining-gw/merchant/web/transactions/history?select=transactions&res_id=21659582&start_date=2026-06-20&end_date=2026-06-20&offset=10&limit=10&activeTabId=transactions&service_type=dine_out>
{'bill_amount': '1071',
 'confirmation_code': 1713,
 'created_by': 'Rakesh',
 'payment_info': '[{"type": "bill_amount", "label": "Bill amount", "value": '
                 '"\\u20b91,071"}, {"type": "discount", "label": "Total '
                 'discount", "value": "\\u20b9160.65", "items": [{"type": '
                 '"user_salt_discount", "label": "Pre-book discount", "value": '
                 '"\\u20b9160.65"}]}, {"type": "tip_amount", "label": "Tips", '
                 '"value": ""}, {"type": "user_paid_amount", "label": "Paid '
                 'amount", "value": "\\u20b9910.35"}]',
 'payout_info': '[{"type": "gross_revenue_a", "label": "Gross revenue after '
                'discounts (A)", "value": "\\u20b9910.35"}, {"type": '
                '"additions_b", "label": "Additions (B)", "value": "", '
                '"items": [{"type": "tip", "label": "Tip for the staff", '
                '"value": ""}]}, {"type": "deductions_b", "label": "Deductions '
                '(C)", "value": "\\u20b932.23", "items": [{"type": '
                '"commission", "label": "Commission", "value": '
                '"-\\u20b927.31"}, {"type": "tax_on_commission", "label": "Tax '
                'on commission", "value": "-\\u20b94.92"}]}, {"type": '
                '"net_receivable", "label": "Net receivable (A+B-C)", "value": '
                '"\\u20b9878.12"}]',
 'payout_settlement_date': '2026-06-22',
 'payout_status': 'pending',
 'rating': None,
 'res_id': 21659582,
 'settlement_amount': '878.12',
 'status': 'success',
 'timestamp': '2026-06-20T10:01:00+00:00',
 'transaction_id': 6798931607,
 'user_paid_amount': '910.35'}
2026-06-21 04:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/dining-gw/merchant/web/transactions/history?select=transactions&res_id=21659582&start_date=2026-06-20&end_date=2026-06-20&offset=10&limit=10&activeTabId=transactions&service_type=dine_out>
{'bill_amount': '2244',
 'confirmation_code': 9632,
 'created_by': 'Evangelin',
 'payment_info': '[{"type": "bill_amount", "label": "Bill amount", "value": '
                 '"\\u20b92,244"}, {"type": "discount", "label": "Total '
                 'discount", "value": ""}, {"type": "tip_amount", "label": '
                 '"Tips", "value": ""}, {"type": "user_paid_amount", "label": '
                 '"Paid amount", "value": "\\u20b92,244"}]',
 'payout_info': '[{"type": "gross_revenue_a", "label": "Gross revenue after '
                'discounts (A)", "value": "\\u20b92,244"}, {"type": '
                '"additions_b", "label": "Additions (B)", "value": "", '
                '"items": [{"type": "tip", "label": "Tip for the staff", '
                '"value": ""}]}, {"type": "deductions_b", "label": "Deductions '
                '(C)", "value": "\\u20b979.44", "items": [{"type": '
                '"commission", "label": "Commission", "value": '
                '"-\\u20b967.32"}, {"type": "tax_on_commission", "label": "Tax '
                'on commission", "value": "-\\u20b912.12"}]}, {"type": '
                '"net_receivable", "label": "Net receivable (A+B-C)", "value": '
                '"\\u20b92,164.56"}]',
 'payout_settlement_date': '2026-06-22',
 'payout_status': 'pending',
 'rating': '5',
 'res_id': 21659582,
 'settlement_amount': '2164.56',
 'status': 'success',
 'timestamp': '2026-06-20T09:51:00+00:00',
 'transaction_id': 2424026511,
 'user_paid_amount': '2244'}
2026-06-21 04:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/dining-gw/merchant/web/transactions/history?select=transactions&res_id=21659582&start_date=2026-06-20&end_date=2026-06-20&offset=10&limit=10&activeTabId=transactions&service_type=dine_out>
{'bill_amount': '3095',
 'confirmation_code': 7592,
 'created_by': 'Sanjeev',
 'payment_info': '[{"type": "bill_amount", "label": "Bill amount", "value": '
                 '"\\u20b93,095"}, {"type": "discount", "label": "Total '
                 'discount", "value": "\\u20b9464.25", "items": [{"type": '
                 '"user_salt_discount", "label": "Pre-book discount", "value": '
                 '"\\u20b9464.25"}]}, {"type": "tip_amount", "label": "Tips", '
                 '"value": ""}, {"type": "user_paid_amount", "label": "Paid '
                 'amount", "value": "\\u20b92,630.75"}]',
 'payout_info': '[{"type": "gross_revenue_a", "label": "Gross revenue after '
                'discounts (A)", "value": "\\u20b92,630.75"}, {"type": '
                '"additions_b", "label": "Additions (B)", "value": "", '
                '"items": [{"type": "tip", "label": "Tip for the staff", '
                '"value": ""}]}, {"type": "deductions_b", "label": "Deductions '
                '(C)", "value": "\\u20b993.13", "items": [{"type": '
                '"commission", "label": "Commission", "value": '
                '"-\\u20b978.92"}, {"type": "tax_on_commission", "label": "Tax '
                'on commission", "value": "-\\u20b914.21"}]}, {"type": '
                '"net_receivable", "label": "Net receivable (A+B-C)", "value": '
                '"\\u20b92,537.62"}]',
 'payout_settlement_date': '2026-06-22',
 'payout_status': 'pending',
 'rating': '5',
 'res_id': 21659582,
 'settlement_amount': '2537.62',
 'status': 'success',
 'timestamp': '2026-06-20T08:49:00+00:00',
 'transaction_id': 5005515861,
 'user_paid_amount': '2630.75'}
2026-06-21 04:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/dining-gw/merchant/web/transactions/history?select=transactions&res_id=21659582&start_date=2026-06-20&end_date=2026-06-20&offset=10&limit=10&activeTabId=transactions&service_type=dine_out>
{'bill_amount': '1784',
 'confirmation_code': 7559,
 'created_by': 'Ananya Banerjee',
 'payment_info': '[{"type": "bill_amount", "label": "Bill amount", "value": '
                 '"\\u20b91,784"}, {"type": "discount", "label": "Total '
                 'discount", "value": "\\u20b9267.6", "items": [{"type": '
                 '"user_salt_discount", "label": "Pre-book discount", "value": '
                 '"\\u20b9267.6"}]}, {"type": "tip_amount", "label": "Tips", '
                 '"value": ""}, {"type": "user_paid_amount", "label": "Paid '
                 'amount", "value": "\\u20b91,516.4"}]',
 'payout_info': '[{"type": "gross_revenue_a", "label": "Gross revenue after '
                'discounts (A)", "value": "\\u20b91,516.4"}, {"type": '
                '"additions_b", "label": "Additions (B)", "value": "", '
                '"items": [{"type": "tip", "label": "Tip for the staff", '
                '"value": ""}]}, {"type": "deductions_b", "label": "Deductions '
                '(C)", "value": "\\u20b953.68", "items": [{"type": '
                '"commission", "label": "Commission", "value": '
                '"-\\u20b945.49"}, {"type": "tax_on_commission", "label": "Tax '
                'on commission", "value": "-\\u20b98.19"}]}, {"type": '
                '"net_receivable", "label": "Net receivable (A+B-C)", "value": '
                '"\\u20b91,462.72"}]',
 'payout_settlement_date': '2026-06-22',
 'payout_status': 'pending',
 'rating': '5',
 'res_id': 21659582,
 'settlement_amount': '1462.72',
 'status': 'success',
 'timestamp': '2026-06-20T08:36:00+00:00',
 'transaction_id': 9646297436,
 'user_paid_amount': '1516.4'}
2026-06-21 04:30:32 [scrapy.core.engine] INFO: Closing spider (finished)
2026-06-21 04:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): cron.restaverse.com:443
2026-06-21 04:30:32 [urllib3.connectionpool] DEBUG: https://cron.restaverse.com:443 "POST /api/db_services/fetch-query HTTP/11" 200 93
2026-06-21 04:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): cron.restaverse.com:443
2026-06-21 04:30:32 [urllib3.connectionpool] DEBUG: https://cron.restaverse.com:443 "POST /insert_data/ HTTP/11" 201 112
2026-06-21 04:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443
2026-06-21 04:30:33 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/stats/ HTTP/11" 200 109
2026-06-21 04:30:33 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'client_id': '2',
 'downloader/request_bytes': 52645,
 'downloader/request_count': 12,
 'downloader/request_method_count/GET': 12,
 'downloader/response_bytes': 47581,
 'downloader/response_count': 12,
 'downloader/response_status_count/200': 12,
 'elapsed_time_seconds': 22.326894,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 6, 21, 4, 30, 32, 889749, tzinfo=datetime.timezone.utc),
 'httpcompression/response_bytes': 188367,
 'httpcompression/response_count': 8,
 'item_scraped_count': 19,
 'items_per_minute': None,
 'log_count/DEBUG': 78,
 'log_count/ERROR': 1,
 'log_count/INFO': 26,
 'log_count/WARNING': 46,
 'memusage/max': 118947840,
 'memusage/startup': 118947840,
 'request_depth_max': 8,
 'response_received_count': 12,
 'responses_per_minute': None,
 'scheduler/dequeued': 12,
 'scheduler/dequeued/memory': 12,
 'scheduler/enqueued': 12,
 'scheduler/enqueued/memory': 12,
 'start_time': datetime.datetime(2026, 6, 21, 4, 30, 10, 562855, tzinfo=datetime.timezone.utc)}
2026-06-21 04:30:33 [scrapy.core.engine] INFO: Spider closed (finished)
2026-06-21 04:30:33 [scrapy.utils.signal] ERROR: Error caught on signal handler: <bound method TelnetConsole.stop_listening of <scrapy.extensions.telnet.TelnetConsole object at 0xf169a7729b40>>
Traceback (most recent call last):
  File "/home/ubuntu/restaverse_spiders/venv/lib/python3.10/site-packages/scrapy/utils/defer.py", line 400, in maybeDeferred_coro
    result = f(*args, **kw)
  File "/home/ubuntu/restaverse_spiders/venv/lib/python3.10/site-packages/pydispatch/robustapply.py", line 55, in robustApply
    return receiver(*arguments, **named)
  File "/home/ubuntu/restaverse_spiders/venv/lib/python3.10/site-packages/scrapy/extensions/telnet.py", line 76, in stop_listening
    self.port.stopListening()
AttributeError: 'TelnetConsole' object has no attribute 'port'