Crawlomatic multisite scraper post generator plugin for wordpress is a breaking edge website crawling and scraping, post generator autoblogging plugin that uses website crawling and scraping to turn your website into a autoblogging or even a money making machine!
Get content from almost any webpage! You no longer need api’s which requires registration and provides limited access. You can retrieve data from non api providing websites. Schedule it for once and let it autopilot your posts 7/24 for you like a master!
This plugin will crawl the seed url you give it (crawling means that it will search all links that the webpage contains) and will visit and extract content from each crawled url. The crawling process is customizable: you can set the crawling depth, crawling rate, maximum crawled article count, crawl only links with specific class or id and many more customizations.
In the v2.0 update, a new live scraper shortcode was added to the plugin, the [crawlomatic-scraper]. This new feature makes this plugin an easy to implement web data extractor for wordpress. As a result, it can be used to display real-time data from any websites directly into your posts, pages or sidebar. You can use this plugin to include real-time stock quotes, cricket or soccer scores or any other generic content from public domains! You can scrape content from almost every web site that you open in your browser.
– Configurable useragent for your scraper can be set for every scrape
– Scraped output can be displayed through custom template tag, shortcode in page, post and sidebar (through a text widget)
– Configurable default settings like enabling, useragent, timeout, caching, error handling
– Multiple ways to query content – css selector, xpath or regex, auto detection
– Configurable caching of scraped data
– Cache timeout can be defined in minutes for every scraped data
– A wide range of arguments for parsing content
– Option to pass post arguments to a url to be scraped
– Dynamic conversion of scraped content to specified character encoding to scrape data from a site using different charset
– Create scraped pages on the fly using dynamic generation of urls to scrape or post arguments based on your page’s get or post arguments
– Callback function for advanced parsing of scraped data
– Crawl RSS feeds for links and scrape articles listed in them
– Scrape onion websites from the dark web using the tor browser and puppeteer
– Live scraper shortcode added for even more crawling control and scraping power
– Sitemap crawling supported
– Visual content selector support
– Added the ability to make screenshots of crawled pages and use them in generated post’s content
Ability to shorten outgoing (post source) links (and monetize them), using shorte.st link shortener service
– below the complete list
CRAWLOMATIC PLUGIN UPDATES
For update request contact our support, and we will notify you to the email entered. We don’t offer technical support for crawlomatic. If you’d like to be supported, please purchase the full version.