Part of the system for fetching live auctions from auction sites. The application collects auctions and lots and then classified by location, category, bid, bids count and etc. The project contains an XML and HTML parser, as well as custom parsers for dynamically generated pages. A parsing application. This application parses more than 50 websites. It works with HTML, JS code, POST requests and it also parses JSON responses. All parsing results write to the database. After parsing, the application sends logs to the email.
Industries: Legal services, Software manufacturers, Industry
Solution: Media content management
Technologies and tools: Java, Jsoup, Jdbc , Maven, MySql, Git