Estimatein 1 hour

Articles on software development

Pricing, timelines, technologies and pitfalls — written from our own projects.

All articlesWeb services & CRMMobile appsParsing & dataMobile games
Web services & CRM

Parsing PDFs and Web Documents: Extracting Structure

Breaking down optical character recognition (OCR) and Tabula technologies to extract structured data from PDFs retrieved from web pages.

Read →
Web services & CRM

Python for Web Scraping: BeautifulSoup, Scrapy, httpx — Choosing the Right Stack

Which tool to choose for web scraping in Python: lightweight BeautifulSoup, async httpx, or full-fledged Scrapy framework. Compare use cases and production best practices.

Read →
Web services & CRM

News Feed and RSS Parsing: Aggregation for Media and Analytics – Sources, Deduplication, Classification

Learn how to build a news aggregation system: connecting RSS feeds and websites, content deduplication methods, classification using…

Read →
Web services & CRM

Competitor Website Change Monitoring: Diff Technologies and Notification Systems

Automating competitor website change tracking helps you gain an edge. We explore diff algorithms, watchers, and more.

Read →
Web services & CRM

Parsing B2B Price Lists and Wholesale Catalogs for Procurement

Automated collection of prices and assortment from B2B portals and wholesale catalogs. Supplier comparison, loading into ERP. ESK solutions for procurement departments.

Read →
Web services & CRM

Serverless Scraping or Dedicated Servers: Economics and Reliability

Comparing the economics and reliability of serverless scraping on AWS Lambda with dedicated servers. Cost analysis, scalability, and practical implementation…

Read →
Web services & CRM

SERP Parsing and SEO Competitors: Tools and Methodology for Collecting Positions, Snippets, and Frequency

Learn to parse positions, snippets, and keyword frequency from SERP: tools overview, methodology, and data integration into reports. Practical insights for SEO.

Read →
Web services & CRM

Legal Aspects of Web Scraping in Russia and the EU: robots.txt, ToS, and Personal Data

A comprehensive breakdown of the legal boundaries of web scraping: requirements of robots.txt and terms of service, protection of personal data under Federal Law 152-FZ and GDPR.

Read →
Web services & CRM

Parser Scaling: Queues, Workers, Distributed Collection

We analyze the architecture of horizontally scalable parsers with message queues and workers. Queues based on Redis and RabbitMQ, distributed...

Read →
Web services & CRM

Scraping Reviews and Ratings from Marketplaces: From Data to Reputation Analytics

Collect reviews and ratings from Ozon, Wildberries, Yandex.Market for sentiment analysis, reputation monitoring, and BI system integration. Learn more…

Read →
Web services & CRM

ETL Pipelines for Parsing Data: Storage, Normalization, and Data Quality

Designing ETL processes for parsing data: PostgreSQL storage architecture, queue usage, deduplication, and quality control…

Read →
Web services & CRM

Scraping vs Official API: When HTML Data Collection Is Justified

We examine when HTML scraping is cheaper and provides more complete data, and when it's safer to rely on an API. We evaluate total cost of ownership and reliability.

Read →

Didn't find an answer?

Describe the task in a couple of sentences — we'll name the timeline and price in both models within an hour.

Reply viawithin an hour