Software characteristics
1. Visualization and custom collection process
Full Q & A guidance, visualization operation, custom collection process
Automatic recording and simulation webpage operation order
Advanced settings meet more collection needs
2. Click to draw web data
Mouse click to select the web page content and operation that you want to crawl
You can choose to extract text, links, attributes, HTML tags, etc.
3. Run batch collection data
Software automatically collects in accordance with the collection process and extraction rules
Quick and stable, display the collection speed and process in real time
Can switch the software background run without disturbing the front desk work
4. Export and publish data
The collected data automatically tables, free configuration fields
Support data export to local files such as Excel
And one -click to publish to the CMS website/database/WeChat public account and other media
Use
Customize the method of collecting Baidu search results data
Step 1: Create the collection task
1) Start the Houyi collector, enter the main interface, select custom collection and click to create the task button to create "custom collection task"
2) Enter the URL of Baidu search, including three ways
1. Manual input: Enter the URL directly in the input box.
2. Click to read from the file: The user selects a file that stores URL. There are multiple URL addresses in the file, and the address needs to be divided into division.
3. Batch addition method: By adding and adjusting address parameters to generate multiple regular addresses
Step 2: Customized collection process
1) After clicking Create, automatically open the first URL and enter the custom settings page. The process blocks that start, open the webpage, and end the process block. The bottom template area is used to drag and drag into the canvas to generate a new process block;
2) Add input text block: Drag and drag input text blocks near the bottom template area to open behind the web block. When the shadow area appears, you can loosen the mouse. At this time
3) Generate a full flow chart: Improve the drag process of the input text block adding a new block: as shown in the figure below:
Key step block settings introduction
Step 2: Wait regularly to wait for the webpage to complete
Step 3: Click the input box XPath property button, click the icon in the attribute menu to select the input box in the webpage, click the input text property button, and enter the text to be searched in the menu.
Step 4: For setting to click the search button, click the XPATH property button of the element, click on the icon in the menu, and then click the Baidu button in the webpage.
Step 5: It is used to set the cycle to load the next list page. Set detailed conditions in the circular condition block inside the circula block. Click the operation button here, select a single element, and then click the XPATH property button of the element in the attribute menu to select the next page of the next page in the same page. The number of loop number attribute buttons can be default to 0, that is, the number of times the next page is not limited.
Step 6: It is used to set the data in the loop drawing list page. Set detailed conditions in the circulating condition block inside the circular block. Click on the operation button here, select the list of non -fixed element, and then click the XPATH property button of the element in the attribute menu, and then select the first piece on the webpage twice to extract the first piece. And the second element. The number of loop number attribute buttons can be default to 0, that is, the number of fields charged in the list does not limit.
Step 7: Used to execute the next page button to operate, click the element XPATH property button, and select the Xpath option of the element in the current cycle.
Step 8: Similarly to set up web pages to load waiting time.
Step 9: The field rules for setting on the list page, click the element button in the loop in the attribute button, and select the element option in the cycle. Click the element template attribute button to click addition and subtraction in the field table to add and delete the field. Add the field to use the point to select the operation, that is, click the mouse to move to the web element to click to select.
4) Click to start collection, start collection
Step 3: Data collection and export
1) Collect task operation
2) After the collection is completed, select "Export Data" to export the data to the local file
3) Select the "Export method" to export the collected data. Here you can choose Excel as the export as format
4) After the collection data is exported, as shown below
The Houyi collector is a web data collection software created by the original Google technology team. It can be visually selected. One -click collection of web data, the entire platform, Win/Mac/Linux is available, collected and exported for free, unlimited limit, no limit Use with confidence, but run in the background, display in real time.
it works
it works
it works