Search engines statistics collector
Windows service to check websites positions in Google, Yandex, Rambler search engines
Windows service to check websites positions in Google, Yandex, Rambler against specific keywords.
The project consists of Windows service and number of web services to gather search statistics from Yandex, Rambler, Google
System consists of 3 levels:
1) Local web services that are deployed on servers and are responsible to requests search engines using different proxies. By the way each request was sent from different IP (selected from list). For every sent request IP address of network adapter was changing to avoid ip blocking by search engines.
2) Windows service – that sends requests to a list of registered web services to get a result for specifc keyword, collects the data, parses it from html, analyses and stores to DB retrieved statistics.
3) Web application – to configure and monitor web and windows services, configure multilevel html parsing using regular expressions. To interact with windows service Named pipes API was used.
|Technologies:||C#, MS SQL 2005, multithreading, MS Named pipes, Network API, Windows Services, Web Services (SOAP)|
|Dates:||February - June 2009|