ThunderMetrics is the data services division handling data mining, crawling & analytics services of ThunderQuote(TQ), a B2B platform specialising in creating intelligent eProcurement systems.
ThunderMetrics also powers TQ’s intelligent corporate due dilligence and vendor sourcing & matching algorithms through machine intelligence.
Our web data scraping & web data mining solutions have helped businesses all the way from small businesses to F100 multinational corporations. Just tell us what kind you need, and from where, and we’ll take it from there.
Share your project requirements with us so we can generate a quote for you, pricing is based on the websites scraped, amount of data, and complexity of sites scraped.
Experts in Web Scraping Technologies
Ultra-Fine Web Data Scraping,
At Mass Scale
Zero Customer Lock-In
Intelligent Semantic Keyword Detection
Data Or Your Money Back Guarantee
We provide web data scraping & mining services which can be used to accomplish the following use cases and more:
Our professional data crawling experts can help you look into extraction and processing of the following data classes from the public web:
eCommerce Data
Events & Ticketing Data
HR & Recruitment Listings
Education Courses
Ratings & Reviews
Company Profiles
Product & Price Data
News & Media
Travel & Accommodation listings
Get an active data feed in a matter of days
1. Create enquiry
Tell us about the requirements for your project – which type of websites and how often you need the data or leads.
2. Solution architect
Our Process Engineer will design a custom scraping plan to fit your requirements
3. Sample Data
We will deliver a sample data report for your report – setting the high quality bar you require, and adjust for any feedback
4. Scale Crawls
We will scale up your crawls and deliver accurate and reliable data at a speed you requested
5. Maintenance
We will handle any testing or maintenance regarding the data feeds, quality and technical issues that may arise.
Technically we can scrape and give to you any data you can browse or access on your web brower on a website.
However, there are certain legal considerations that need to be taken into account with every project (no scraping beyond password logins, data privacy, T&Cs)
We will walk through your data scraping project requirements with you and help guide you along the way on what kind of data is possible to be extracted while following local law and data scraping best practices.
Extracting data from public websites is legal, however, in certain sites have more stringent T&Cs that prohibit or limit data extraction on their sites, and certain countries will have limitations against extracting personal date, have certain data privacy or IP laws, .
Our team will work with you on your project requirements to help ensure that it follows your local laws and data scraping best practices.
It depends on two factors:
1. How frequently changing the data is. Frequently changing data usually requires a constant data feed subscription.
2. How much filtering/analysis you require of the data extracted. Complex filters and analysis might require more algorithm development.
Our team will understand your project requirements and recommend the best solution for your particular needs.
Once you’ve submitted your initial project requirements, a member of our data systems team will reach out to you to set up a project discovery call. There the data systems planner will discuss your data extraction objectives and what you hope to achieve in detail, and gather the relevant facts needed to help develop the best data-driven solution for your situation. Within a couple of days, we will then present you this planned solution for your approval.
Our systems are built on customised server/browser automation software stacks around the TQ Cloud Scraping Engine of TQ Prospector, available on Google Chrome Store:
At ThunderMetrics we develop data extraction systems for businesses that rely on us for timely insights and sales leads. Therefore, our priority is to deliver high quality data that achieves your objectives. Thus, we have a double QA/QC process that monitors the status of the data pipelines and data quality, and our data storage systems run minute by minute rolling backups with < 1 hr RPO, and < 8 hr RTO.
Setup fees depend on the nature and complexity of the project (ad-hoc data scan, data subscription, custom enterprise data analytics), the difficulty and level of complication in the data structure of the websites and quantity of data being extracted. Our data systems team will assess the websites and provide you with a quote for your team / management approval
Yes, if sample data is available for the data source of your choice, we are happy to provide it in CSV/JSON format. If it is a new website we have not crawled before – sample data will be provided following crawler development kick off. This occurs post purchasing.
We offer many delivery types such as OneDrive, TQ.CDN, AWS S3, Google Cloud storage, Email, Dropbox and Google Drive. Formats for delivery can be CSV, JSON, or data format of your choice, assuming presence of relevant converters.
Vendors
Enterprise
Follow Us on Social Media Platforms
Copy © 2016-2020 ThunderQuote
Terms & Conditions Privacy Policy Security
Fill up the form below and we’ll pass you a link to our sample data for download
Fill up the form below and we’ll pass you a link to our sample data for download
Fill up the form below and we’ll pass you a link to our sample data for download
Fill up the form below and we’ll pass you a link to our sample data for download
Fill up the form below and we’ll pass you a link to our sample data for download
Fill up the form below and we’ll pass you a link to our sample data for download