2026-01-09 03:33:39 [scrapy.utils.log] INFO: Scrapy 2.12.0 started (bot: swiggy_data) 2026-01-09 03:33:39 [scrapy.utils.log] INFO: Versions: lxml 5.3.0.0, libxml2 2.12.9, cssselect 1.2.0, parsel 1.9.1, w3lib 2.2.1, Twisted 24.11.0, Python 3.10.12 (main, Nov 4 2025, 08:48:33) [GCC 11.4.0], pyOpenSSL 24.3.0 (OpenSSL 3.4.0 22 Oct 2024), cryptography 44.0.0, Platform Linux-6.8.0-1044-aws-aarch64-with-glibc2.35 2026-01-09 03:33:39 [swiggy_details] INFO: No delta provided, defaulting to 1 day back 2026-01-09 03:33:39 [scrapy.addons] INFO: Enabled addons: [] 2026-01-09 03:33:39 [asyncio] DEBUG: Using selector: EpollSelector 2026-01-09 03:33:39 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor 2026-01-09 03:33:39 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop 2026-01-09 03:33:39 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor 2026-01-09 03:33:39 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop 2026-01-09 03:33:39 [scrapy.extensions.telnet] INFO: Telnet Password: 98994b6c721d12c0 2026-01-09 03:33:39 [scrapy.middleware] INFO: Enabled extensions: ['scrapy.extensions.corestats.CoreStats', 'scrapy.extensions.telnet.TelnetConsole', 'scrapy.extensions.memusage.MemoryUsage', 'scrapy.extensions.logstats.LogStats', 'scrapeops_scrapy.extension.ScrapeOpsMonitor'] 2026-01-09 03:33:39 [scrapy.crawler] INFO: Overridden settings: {'BOT_NAME': 'swiggy_data', 'FEED_EXPORT_ENCODING': 'utf-8', 'LOG_FILE': '/home/ubuntu/restaverse_spiders/logs/swiggy_data/swiggy_details/275_2026-01-09T03_30_01.log', 'NEWSPIDER_MODULE': 'swiggy_data.spiders', 'ROBOTSTXT_OBEY': True, 'SPIDER_MODULES': ['swiggy_data.spiders'], 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor'} 2026-01-09 03:33:39 [scrapy.middleware] INFO: Enabled downloader middlewares: ['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware', 'scrapy.downloadermiddlewares.robotstxt.RobotsTxtMiddleware', 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware', 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware', 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware', 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware', 'scrapeops_scrapy.middleware.retry.RetryMiddleware', 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware', 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware', 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware', 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware', 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware', 'scrapy.downloadermiddlewares.stats.DownloaderStats'] 2026-01-09 03:33:39 [scrapy.middleware] INFO: Enabled spider middlewares: ['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware', 'scrapy.spidermiddlewares.referer.RefererMiddleware', 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware', 'scrapy.spidermiddlewares.depth.DepthMiddleware'] 2026-01-09 03:33:39 [scrapy.middleware] INFO: Enabled item pipelines: ['swiggy_data.pipelines.SwiggyDataPipeline'] 2026-01-09 03:33:39 [scrapy.core.engine] INFO: Spider opened 2026-01-09 03:33:39 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2026-01-09 03:33:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.scrapeops.io:443 2026-01-09 03:33:40 [urllib3.connectionpool] DEBUG: https://api.scrapeops.io:443 "POST /api/v1/setup/ HTTP/11" 200 None 2026-01-09 03:33:40 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6025 2026-01-09 03:33:40 [botocore.credentials] INFO: Found credentials in environment variables. 2026-01-09 03:33:41 [scrapy.downloadermiddlewares.offsite] DEBUG: Filtered offsite request to 'cron.restaverse.com': 2026-01-09 03:33:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://partner-self-client.swiggy.com/) 2026-01-09 03:33:42 [swiggy_details] INFO: Scraping Swiggy data | client_id=275 | date=2026-01-08 2026-01-09 03:33:43 [scrapy.core.engine] DEBUG: Crawled (404) (referer: https://partner-self-client.swiggy.com/) 2026-01-09 03:33:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '47', 'city': 'Delhi & NCR', 'client_id': '275', 'date': '2026-01-08', 'menu': '121', 'new_customers': '7', 'orders': '14', 'repeat_customers': '6', 'res_id': '1020052', 'sub_zone': 'Noida Sec 62'} 2026-01-09 03:33:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '78', 'city': 'Delhi & NCR', 'client_id': '275', 'date': '2026-01-08', 'menu': '186', 'new_customers': '10', 'orders': '23', 'repeat_customers': '13', 'res_id': '111666', 'sub_zone': 'Noida 46'} 2026-01-09 03:33:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '36', 'city': 'Maharashtra', 'client_id': '275', 'date': '2026-01-08', 'menu': '81', 'new_customers': '10', 'orders': '16', 'repeat_customers': '6', 'res_id': '1004110', 'sub_zone': 'Mumbai Borivali'} 2026-01-09 03:33:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '17', 'city': 'Uttarpradesh', 'client_id': '275', 'date': '2026-01-08', 'menu': '37', 'new_customers': '1', 'orders': '4', 'repeat_customers': '2', 'res_id': '1076854', 'sub_zone': 'Muzaffarnagar'} 2026-01-09 03:33:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '53', 'city': 'Hydrabad', 'client_id': '275', 'date': '2026-01-08', 'menu': '132', 'new_customers': '7', 'orders': '9', 'repeat_customers': '2', 'res_id': '1047997', 'sub_zone': 'Malla Reddy HYD'} 2026-01-09 03:33:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '42', 'city': 'Punjab', 'client_id': '275', 'date': '2026-01-08', 'menu': '70', 'new_customers': '6', 'orders': '14', 'repeat_customers': '7', 'res_id': '1058625', 'sub_zone': 'Faridkot Punjab'} 2026-01-09 03:33:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '6', 'city': 'Uttarakhand', 'client_id': '275', 'date': '2026-01-08', 'menu': '30', 'new_customers': '1', 'orders': '2', 'repeat_customers': '1', 'res_id': '1057632', 'sub_zone': 'Haldwani UK'} 2026-01-09 03:33:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '65', 'city': 'Chandigarh', 'client_id': '275', 'date': '2026-01-08', 'menu': '164', 'new_customers': '9', 'orders': '22', 'repeat_customers': '12', 'res_id': '1057888', 'sub_zone': 'Kharar Punjab'} 2026-01-09 03:33:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'The Sausauge Fest', 'cart': '5', 'city': 'Delhi & NCR', 'client_id': '275', 'date': '2026-01-08', 'menu': '28', 'new_customers': '1', 'orders': '2', 'repeat_customers': '0', 'res_id': '1149901', 'sub_zone': 'Prashant Vihar'} 2026-01-09 03:33:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'The Sausauge Fest', 'cart': '4', 'city': 'Delhi & NCR', 'client_id': '275', 'date': '2026-01-08', 'menu': '19', 'new_customers': '2', 'orders': '2', 'repeat_customers': '1', 'res_id': '1150171', 'sub_zone': 'Hauzkhas'} 2026-01-09 03:33:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'The Sausauge Fest', 'cart': '11', 'city': 'Delhi & NCR', 'client_id': '275', 'date': '2026-01-08', 'menu': '20', 'new_customers': '2', 'orders': '4', 'repeat_customers': '2', 'res_id': '1150177', 'sub_zone': 'Greater Kailash 2'} 2026-01-09 03:33:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'The Sausauge Fest', 'cart': '5', 'city': 'Delhi & NCR', 'client_id': '275', 'date': '2026-01-08', 'menu': '27', 'new_customers': '1', 'orders': '1', 'repeat_customers': '0', 'res_id': '1150206', 'sub_zone': 'Dwarka Delhi'} 2026-01-09 03:33:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'The Sausauge Fest', 'cart': '0', 'city': 'Delhi & NCR', 'client_id': '275', 'date': '2026-01-08', 'menu': '13', 'new_customers': '0', 'orders': '0', 'repeat_customers': '0', 'res_id': '1150225', 'sub_zone': 'Baani Square'} 2026-01-09 03:33:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'The Sausauge Fest', 'cart': '8', 'city': 'Delhi & NCR', 'client_id': '275', 'date': '2026-01-08', 'menu': '31', 'new_customers': '2', 'orders': '2', 'repeat_customers': '0', 'res_id': '1150199', 'sub_zone': 'Rajinder Nagar'} 2026-01-09 03:33:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '77', 'city': 'Delhi & NCR', 'client_id': '275', 'date': '2026-01-08', 'menu': '186', 'new_customers': '15', 'orders': '28', 'repeat_customers': '11', 'res_id': '919391', 'sub_zone': 'GWS Noida'} 2026-01-09 03:33:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'The Sausauge Fest', 'cart': '0', 'city': 'Delhi & NCR', 'client_id': '275', 'date': '2026-01-08', 'menu': '0', 'new_customers': '0', 'orders': '0', 'repeat_customers': '0', 'res_id': '1150214', 'sub_zone': 'Gurugram Golf Course'} 2026-01-09 03:33:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'The Sausauge Fest', 'cart': '5', 'city': 'Delhi & NCR', 'client_id': '275', 'date': '2026-01-08', 'menu': '21', 'new_customers': '2', 'orders': '2', 'repeat_customers': '0', 'res_id': '1150231', 'sub_zone': 'Gurugram Sec 4'} 2026-01-09 03:33:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '0', 'city': 'Uttarpradesh', 'client_id': '275', 'date': '2026-01-08', 'menu': '10', 'new_customers': '0', 'orders': '0', 'repeat_customers': '0', 'res_id': '920214', 'sub_zone': 'Agra PPM'} 2026-01-09 03:33:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '39', 'city': 'Punjab', 'client_id': '275', 'date': '2026-01-08', 'menu': '86', 'new_customers': '6', 'orders': '15', 'repeat_customers': '10', 'res_id': '931770', 'sub_zone': '100 Ft Amritsar'} 2026-01-09 03:33:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '20', 'city': 'Delhi & NCR', 'client_id': '275', 'date': '2026-01-08', 'menu': '67', 'new_customers': '5', 'orders': '7', 'repeat_customers': '4', 'res_id': '931764', 'sub_zone': 'Okas Noida 142'} 2026-01-09 03:33:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '152', 'city': 'Delhi & NCR', 'client_id': '275', 'date': '2026-01-08', 'menu': '350', 'new_customers': '10', 'orders': '46', 'repeat_customers': '38', 'res_id': '91817', 'sub_zone': 'Prashant Vihar'} 2026-01-09 03:33:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '44', 'city': 'Delhi & NCR', 'client_id': '275', 'date': '2026-01-08', 'menu': '122', 'new_customers': '8', 'orders': '12', 'repeat_customers': '6', 'res_id': '959142', 'sub_zone': 'Noida Alpha-1'} 2026-01-09 03:33:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '0', 'city': 'Delhi & NCR', 'client_id': '275', 'date': '2026-01-08', 'menu': '0', 'new_customers': '0', 'orders': '0', 'repeat_customers': '0', 'res_id': '974262', 'sub_zone': 'KidZania'} 2026-01-09 03:33:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '76', 'city': 'Delhi & NCR', 'client_id': '275', 'date': '2026-01-08', 'menu': '166', 'new_customers': '15', 'orders': '32', 'repeat_customers': '15', 'res_id': '790599', 'sub_zone': 'Gurugram Sec 4'} 2026-01-09 03:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '9', 'city': 'Haryana', 'client_id': '275', 'date': '2026-01-08', 'menu': '20', 'new_customers': '0', 'orders': '1', 'repeat_customers': '1', 'res_id': '866924', 'sub_zone': 'Karnal - Neelkanth'} 2026-01-09 03:33:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '120', 'city': 'Rajasthan', 'client_id': '275', 'date': '2026-01-08', 'menu': '226', 'new_customers': '9', 'orders': '31', 'repeat_customers': '20', 'res_id': '791987', 'sub_zone': 'Jaipur Rajapark'} 2026-01-09 03:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '48', 'city': 'Delhi & NCR', 'client_id': '275', 'date': '2026-01-08', 'menu': '93', 'new_customers': '7', 'orders': '11', 'repeat_customers': '4', 'res_id': '787077', 'sub_zone': 'Mayur Vihar'} 2026-01-09 03:33:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '24', 'city': 'Uttarakhand', 'client_id': '275', 'date': '2026-01-08', 'menu': '49', 'new_customers': '2', 'orders': '7', 'repeat_customers': '5', 'res_id': '772595', 'sub_zone': 'Roorkee'} 2026-01-09 03:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '14', 'city': 'Maharashtra', 'client_id': '275', 'date': '2026-01-08', 'menu': '48', 'new_customers': '2', 'orders': '4', 'repeat_customers': '2', 'res_id': '730287', 'sub_zone': 'Jalgaon'} 2026-01-09 03:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '69', 'city': 'Punjab', 'client_id': '275', 'date': '2026-01-08', 'menu': '143', 'new_customers': '8', 'orders': '22', 'repeat_customers': '13', 'res_id': '75333', 'sub_zone': 'Amritsar'} 2026-01-09 03:33:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '78', 'city': 'Delhi & NCR', 'client_id': '275', 'date': '2026-01-08', 'menu': '137', 'new_customers': '8', 'orders': '19', 'repeat_customers': '12', 'res_id': '721713', 'sub_zone': 'Gurugram Golf Course'} 2026-01-09 03:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '31', 'city': 'Punjab', 'client_id': '275', 'date': '2026-01-08', 'menu': '77', 'new_customers': '2', 'orders': '6', 'repeat_customers': '3', 'res_id': '682496', 'sub_zone': 'Hoshiarpur'} 2026-01-09 03:33:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '134', 'city': 'Uttarakhand', 'client_id': '275', 'date': '2026-01-08', 'menu': '244', 'new_customers': '5', 'orders': '30', 'repeat_customers': '24', 'res_id': '676814', 'sub_zone': 'Suddowala'} 2026-01-09 03:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '0', 'city': 'Gujarat', 'client_id': '275', 'date': '2026-01-08', 'menu': '0', 'new_customers': '0', 'orders': '0', 'repeat_customers': '0', 'res_id': '668254', 'sub_zone': 'Burgrill Vadodara'} 2026-01-09 03:33:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '0', 'city': 'Delhi & NCR', 'client_id': '275', 'date': '2026-01-08', 'menu': '4', 'new_customers': '0', 'orders': '0', 'repeat_customers': '0', 'res_id': '555508', 'sub_zone': 'Burgrill Faridabad'} 2026-01-09 03:33:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '35', 'city': 'Rajasthan', 'client_id': '275', 'date': '2026-01-08', 'menu': '87', 'new_customers': '2', 'orders': '7', 'repeat_customers': '5', 'res_id': '660544', 'sub_zone': 'Ganganagar'} 2026-01-09 03:33:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '122', 'city': 'Uttarakhand', 'client_id': '275', 'date': '2026-01-08', 'menu': '225', 'new_customers': '9', 'orders': '31', 'repeat_customers': '23', 'res_id': '584079', 'sub_zone': 'Rajpur Road Dehradun'} 2026-01-09 03:33:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '180', 'city': 'Delhi & NCR', 'client_id': '275', 'date': '2026-01-08', 'menu': '335', 'new_customers': '12', 'orders': '47', 'repeat_customers': '32', 'res_id': '67382', 'sub_zone': 'Rajinder Nagar'} 2026-01-09 03:33:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '116', 'city': 'Delhi & NCR', 'client_id': '275', 'date': '2026-01-08', 'menu': '213', 'new_customers': '9', 'orders': '31', 'repeat_customers': '19', 'res_id': '53317', 'sub_zone': 'Greater Kailash 2'} 2026-01-09 03:33:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '52', 'city': 'Punjab', 'client_id': '275', 'date': '2026-01-08', 'menu': '94', 'new_customers': '4', 'orders': '7', 'repeat_customers': '2', 'res_id': '547671', 'sub_zone': 'Amritsar GGU'} 2026-01-09 03:33:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '40', 'city': 'Punjab', 'client_id': '275', 'date': '2026-01-08', 'menu': '84', 'new_customers': '3', 'orders': '12', 'repeat_customers': '10', 'res_id': '504964', 'sub_zone': 'Bathinda'} 2026-01-09 03:33:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '90', 'city': 'Uttarakhand', 'client_id': '275', 'date': '2026-01-08', 'menu': '178', 'new_customers': '13', 'orders': '27', 'repeat_customers': '15', 'res_id': '519289', 'sub_zone': 'Dehradun'} 2026-01-09 03:33:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '89', 'city': 'Chandigarh', 'client_id': '275', 'date': '2026-01-08', 'menu': '186', 'new_customers': '4', 'orders': '31', 'repeat_customers': '26', 'res_id': '49254', 'sub_zone': 'Panchkula'} 2026-01-09 03:33:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '83', 'city': 'Delhi & NCR', 'client_id': '275', 'date': '2026-01-08', 'menu': '160', 'new_customers': '21', 'orders': '46', 'repeat_customers': '21', 'res_id': '53316', 'sub_zone': 'Janakpuri'} 2026-01-09 03:33:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '153', 'city': 'Chandigarh', 'client_id': '275', 'date': '2026-01-08', 'menu': '307', 'new_customers': '18', 'orders': '57', 'repeat_customers': '39', 'res_id': '47840', 'sub_zone': 'Sector 8 Chandigarh'} 2026-01-09 03:33:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '150', 'city': 'Chandigarh', 'client_id': '275', 'date': '2026-01-08', 'menu': '338', 'new_customers': '22', 'orders': '62', 'repeat_customers': '40', 'res_id': '47838', 'sub_zone': 'Sector 66 Mohali(Bestech)'} 2026-01-09 03:33:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '125', 'city': 'Haryana', 'client_id': '275', 'date': '2026-01-08', 'menu': '236', 'new_customers': '8', 'orders': '30', 'repeat_customers': '20', 'res_id': '456770', 'sub_zone': 'Panipat'} 2026-01-09 03:33:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '135', 'city': 'Chandigarh', 'client_id': '275', 'date': '2026-01-08', 'menu': '285', 'new_customers': '16', 'orders': '53', 'repeat_customers': '35', 'res_id': '47839', 'sub_zone': 'Sector 60 Mohali'} 2026-01-09 03:33:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '56', 'city': 'Rajasthan', 'client_id': '275', 'date': '2026-01-08', 'menu': '100', 'new_customers': '7', 'orders': '19', 'repeat_customers': '14', 'res_id': '415143', 'sub_zone': 'Jodhpur'} 2026-01-09 03:33:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '95', 'city': 'Delhi & NCR', 'client_id': '275', 'date': '2026-01-08', 'menu': '201', 'new_customers': '17', 'orders': '39', 'repeat_customers': '20', 'res_id': '448039', 'sub_zone': 'Baani Square'} 2026-01-09 03:33:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '74', 'city': 'Haryana', 'client_id': '275', 'date': '2026-01-08', 'menu': '175', 'new_customers': '12', 'orders': '24', 'repeat_customers': '12', 'res_id': '364819', 'sub_zone': 'Hisar'} 2026-01-09 03:33:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '90', 'city': 'Delhi & NCR', 'client_id': '275', 'date': '2026-01-08', 'menu': '165', 'new_customers': '6', 'orders': '26', 'repeat_customers': '22', 'res_id': '379407', 'sub_zone': 'Noida 121'} 2026-01-09 03:33:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '73', 'city': 'Delhi & NCR', 'client_id': '275', 'date': '2026-01-08', 'menu': '157', 'new_customers': '9', 'orders': '21', 'repeat_customers': '12', 'res_id': '303200', 'sub_zone': 'Paschim Vihar'} 2026-01-09 03:33:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '189', 'city': 'Delhi & NCR', 'client_id': '275', 'date': '2026-01-08', 'menu': '339', 'new_customers': '7', 'orders': '58', 'repeat_customers': '51', 'res_id': '29811', 'sub_zone': 'Rajouri'} 2026-01-09 03:33:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '80', 'city': 'Punjab', 'client_id': '275', 'date': '2026-01-08', 'menu': '143', 'new_customers': '6', 'orders': '20', 'repeat_customers': '11', 'res_id': '401054', 'sub_zone': 'Jalandhar'} 2026-01-09 03:33:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '145', 'city': 'Delhi & NCR', 'client_id': '275', 'date': '2026-01-08', 'menu': '289', 'new_customers': '9', 'orders': '35', 'repeat_customers': '28', 'res_id': '186181', 'sub_zone': 'Dwarka Delhi'} 2026-01-09 03:33:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '172', 'city': 'Delhi & NCR', 'client_id': '275', 'date': '2026-01-08', 'menu': '317', 'new_customers': '10', 'orders': '35', 'repeat_customers': '25', 'res_id': '206300', 'sub_zone': 'Hudson lane delhi'} 2026-01-09 03:33:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'The Sausauge Fest', 'cart': '0', 'city': 'Chandigarh', 'client_id': '275', 'date': '2026-01-08', 'menu': '1', 'new_customers': '0', 'orders': '0', 'repeat_customers': '0', 'res_id': '1275908', 'sub_zone': 'Pooja Plazzio'} 2026-01-09 03:33:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'The Sausauge Fest', 'cart': '0', 'city': 'Maharashtra', 'client_id': '275', 'date': '2026-01-08', 'menu': '0', 'new_customers': '0', 'orders': '0', 'repeat_customers': '0', 'res_id': '1261798', 'sub_zone': 'Mumbai Borivali'} 2026-01-09 03:33:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'The Sausauge Fest', 'cart': '1', 'city': 'Chandigarh', 'client_id': '275', 'date': '2026-01-08', 'menu': '11', 'new_customers': '0', 'orders': '0', 'repeat_customers': '0', 'res_id': '1261797', 'sub_zone': 'Sector 8 Chandigarh'} 2026-01-09 03:33:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'The Sausauge Fest', 'cart': '0', 'city': 'Chandigarh', 'client_id': '275', 'date': '2026-01-08', 'menu': '4', 'new_customers': '0', 'orders': '0', 'repeat_customers': '0', 'res_id': '1261795', 'sub_zone': 'Sector 60 Mohali'} 2026-01-09 03:33:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '196', 'city': 'Delhi & NCR', 'client_id': '275', 'date': '2026-01-08', 'menu': '372', 'new_customers': '20', 'orders': '71', 'repeat_customers': '50', 'res_id': '121916', 'sub_zone': 'Hauzkhas'} 2026-01-09 03:33:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'The Sausauge Fest', 'cart': '4', 'city': 'Delhi & NCR', 'client_id': '275', 'date': '2026-01-08', 'menu': '13', 'new_customers': '1', 'orders': '1', 'repeat_customers': '0', 'res_id': '1225079', 'sub_zone': 'Okas Noida 142'} 2026-01-09 03:33:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '43', 'city': 'Delhi & NCR', 'client_id': '275', 'date': '2026-01-08', 'menu': '111', 'new_customers': '11', 'orders': '15', 'repeat_customers': '4', 'res_id': '1179732', 'sub_zone': 'Sector 70'} 2026-01-09 03:33:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'The Sausauge Fest', 'cart': '0', 'city': 'Chandigarh', 'client_id': '275', 'date': '2026-01-08', 'menu': '7', 'new_customers': '0', 'orders': '0', 'repeat_customers': '0', 'res_id': '1261793', 'sub_zone': 'Sector 66 Mohali(Bestech)'} 2026-01-09 03:33:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '7', 'city': 'Hyderabad', 'client_id': '275', 'date': '2026-01-08', 'menu': '41', 'new_customers': '0', 'orders': '0', 'repeat_customers': '0', 'res_id': '1169438', 'sub_zone': 'Ashoka One Mall'} 2026-01-09 03:33:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'The Sausauge Fest', 'cart': '0', 'city': 'Delhi & NCR', 'client_id': '275', 'date': '2026-01-08', 'menu': '0', 'new_customers': '0', 'orders': '0', 'repeat_customers': '0', 'res_id': '1161813', 'sub_zone': 'Vasant Kunj'} 2026-01-09 03:33:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://cron.restaverse.com/api/db_services/fetch-query) 2026-01-09 03:33:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://vhc-composer.swiggy.com/query?query=businessMetricsDetails> {'brand': 'Burgrill', 'cart': '20', 'city': 'Punjab', 'client_id': '275', 'date': '2026-01-08', 'menu': '57', 'new_customers': '1', 'orders': '2', 'repeat_customers': '1', 'res_id': '401139', 'sub_zone': 'Gurdaspur'} 2026-01-09 03:33:52 [scrapy.core.engine] INFO: Closing spider (finished) 2026-01-09 03:33:52 [swiggy_details] INFO: Data posted successfully. 2026-01-09 03:33:53 [scrapy.statscollectors] INFO: Dumping Scrapy stats: {'downloader/exception_count': 1, 'downloader/exception_type_count/scrapy.exceptions.IgnoreRequest': 1, 'downloader/request_bytes': 155590, 'downloader/request_count': 70, 'downloader/request_method_count/GET': 1, 'downloader/request_method_count/POST': 69, 'downloader/response_bytes': 98245, 'downloader/response_count': 70, 'downloader/response_status_count/200': 69, 'downloader/response_status_count/404': 1, 'elapsed_time_seconds': 13.045155, 'finish_reason': 'finished', 'finish_time': datetime.datetime(2026, 1, 9, 3, 33, 52, 659736, tzinfo=datetime.timezone.utc), 'httpcompression/response_bytes': 167744, 'httpcompression/response_count': 68, 'item_scraped_count': 68, 'items_per_minute': None, 'log_count/DEBUG': 146, 'log_count/INFO': 13, 'memusage/max': 86372352, 'memusage/startup': 86372352, 'offsite/domains': 1, 'offsite/filtered': 1, 'request_depth_max': 1, 'response_received_count': 70, 'responses_per_minute': None, 'robotstxt/request_count': 2, 'robotstxt/response_count': 1, 'robotstxt/response_status_count/404': 1, 'scheduler/dequeued': 69, 'scheduler/dequeued/memory': 69, 'scheduler/enqueued': 69, 'scheduler/enqueued/memory': 69, 'start_time': datetime.datetime(2026, 1, 9, 3, 33, 39, 614581, tzinfo=datetime.timezone.utc)} 2026-01-09 03:33:53 [scrapy.core.engine] INFO: Spider closed (finished)