Data Collection & Rights FAQ
(Based on the Terms of Use effective December 1, 2026)This page gives general answers to questions we often receive about data collection (web crawling). It is not legal advice. For your specific case, please consult your legal team or a lawyer. If this page differs from the Terms of Use, the Terms of Use prevail. If you have a separate contract with HashScraper (a contract, quotation, special terms, etc.), that contract prevails over the Terms of Use.
- Is web data collection (crawling) allowed?
- Who is responsible for the rights of the target sites?
- How do you view copyright and database rights?
- How do you handle robots.txt?
- How may I use the collected data?
- What if the data contains personal information?
- Does the same apply to bots I build myself (beta)?
- Does this page apply if I have a separate contract?
- What if a site operator asks us to stop collecting?
Is web data collection (crawling) allowed?
No law prohibits web data collection as a whole. However, depending on which site you collect from, what data you collect, how you collect it, and how you use it, issues may arise under copyright law (including the rights of database producers), unfair competition law, personal information protection law, information and communications network law, and the terms of use of the target site.
That is why HashScraper does not say that "any collection is fine." Using public information for your internal work (such as price or market trend analysis) is generally lower risk. Publishing or selling the collected original content as is, or using it for a service that competes with the target site, is generally higher risk.
Who is responsible for the rights of the target sites?
Responsibility is divided as follows (Terms of Use, Article 14).
- HashScraper: is responsible for operating the collection bots and collection facilities it provides in compliance with applicable laws (Paragraph 1).
- Member: decides what to collect (sites, addresses, search terms) and how to use the collected data. The member is therefore responsible for complying with the terms of use of the target sites, copyright and the rights of database producers, personal information protection and other applicable laws, and the rights of third parties (Paragraph 2).
- If a collection target set by the member, or the member's use of the data, violates the rights or terms of use of the target site and a dispute or damage arises, the member is responsible (Paragraph 3).
- However, the Company is responsible for damages caused by its intent or gross negligence, and for damages caused by its failure to fulfill its operating responsibility under Paragraph 1 (Paragraph 4).
How do you view copyright and database rights?
Copyright protects creative expression such as text, photos, and videos. Factual information such as prices, product names, and stock levels is usually not a copyrighted work, but review text, full news articles, and product photos may be.
The rights of database producers protect databases built with substantial investment. Copying all or a substantial part of a site's data, or repeatedly and systematically copying even small parts in a way that conflicts with the normal use of that database, may be an issue.
So when you choose collection targets and fields, we recommend selecting only the fields your work needs. If we determine that a collection requested by a member is likely to infringe the rights of a third party or violate the law, we may refuse or stop that collection after telling the member why (Terms of Use, Article 14, Paragraph 5).
How do you handle robots.txt?
robots.txt is a file in which a site operator states which areas automated collection programs may or may not access. Its legal force is not fixed by law, but because it shows the operator's intent, it may be taken into account if a dispute arises.
- HashScraper controls the speed and frequency of collection so that it does not overload the servers of the target sites.
- For bots that members build themselves (beta), we check robots.txt during review and may reject sites that state they restrict automated collection.
- Checking whether a target site restricts automated collection through robots.txt or its terms of use, and deciding whether to collect from that site, is up to the member (Terms of Use, Article 14, Paragraph 2).
How may I use the collected data?
The member decides the purpose of use and is responsible for it (Terms of Use, Article 14, Paragraphs 2 and 3).
- Generally lower risk: using it for your internal analysis, reporting, and decision-making
- Generally higher risk: publishing or reselling original content such as reviews, articles, or photos as is, or using it to build a service that competes with the target site
Before publishing the collected data or providing it to a third party, we recommend a review by your legal team.
What if the data contains personal information?
If collected data contains personal information, the applicable laws, such as personal information protection law, and our Privacy Policy apply (Terms of Use, Article 11, Paragraph 3). Because the member who decides the collection targets and fields is responsible for complying with personal information protection laws (Terms of Use, Article 14, Paragraph 2), please leave out personal information you do not need. Bots that members build themselves may not be used to gather personal information in bulk (Terms of Use, Article 22).
Does the same apply to bots I build myself (beta)?
For bots that members build themselves through the AI chat, Terms of Use, Article 22 applies first. The member who built the bot is responsible for complying with the terms of use of the target site, copyright and database rights, and personal information protection, and the following collection is not allowed.
- Collection from areas that require login or authentication
- Collection that gathers personal information in bulk
- Collection that infringes the rights of others or interferes with the operation of the service or the target site
The Company may reject approval of any bot, stop its collection, or delete it after telling the member why.
Does this page apply if I have a separate contract?
If you have a separate contract with HashScraper through a contract, quotation, special terms, or similar, that contract applies before the Terms of Use, and the Terms of Use apply only to matters not covered by it (Terms of Use, Article 5, Paragraph 2). Customers who signed a subscription, dedicated server, monthly fee, or similar contract before December 1, 2026 remain under that contract and the previous terms until the contract ends (Addendum to the Terms of Use).
What if a site operator asks us to stop collecting?
If you receive a request to stop collecting or a rights claim from the operator or a rights holder of a target site, please let us know right away at help@hashscraper.com. If HashScraper also determines, for example because of such a request, that there is a risk of rights infringement or legal violation, we may stop that collection after telling you why (Terms of Use, Article 14, Paragraph 5).
