Skip to content

Tags: Bin-Huang/NodeSpider

Tags

0.9.3

Toggle 0.9.3's commit message
publish as version 0.9.3;

rename option `maxConnection` to `concurrency`;
update unit test;
update document;

0.8.2

Toggle 0.8.2's commit message
publish as version 0.8.2

0.8.0

Toggle 0.8.0's commit message
update README.md to the change

0.7.1

Toggle 0.7.1's commit message
publish version 0.7.1;

delete and move some comments and TODOs;

0.7.0

Toggle 0.7.0's commit message
adapt document and unit test to the change;

update to 0.7.0;

0.6.3

Toggle 0.6.3's commit message
done the parameter check function for spider initialization;

add Queue to module export;
add unit test for parameter check when initalize a spider;
modify package's description;
publish package as version 0.6.3

0.6.2

Toggle 0.6.2's commit message
fix the function startTask, debug of task's special info;

add unit test of task's special info, and pass;
move all of test file to folder test, from folder example;
update the package as version 0.6.2;

0.6.1

Toggle 0.6.1's commit message
fix the method retry, parameter `current` should implement ITask;

fix the method queue, task's special option is not supported but special info;
fix the function `startTask`, when execute plan.process there are an error, throw it;
import uuid/v1 instead of uuid;
delete outdated comments;
add warnning about package's stability;
update the package to version 0.6.1

0.6.0

Toggle 0.6.0's commit message
Maybe the support of task's special option is a bad idea: because it …

…will let developer to save more repeated opts in the queue, such as anonymous callback function, which is a waste to memory and is not easy be stored in redis in the future.

Cancel the support  of task's special option, but task's special `info` will be retained;
delete all of unit test about the support of task's special option.
Class Plan has been deleted and replaced by interface IPlan: all object implemented IPlan will been considered as a plan.
To count the different types' connections, add member `currentConnections` to the `_STATE`.
To flexibly limit the max number of connections, the option `maxTotalConnections` has been deleted, and replaced by `maxConnections`, which can be a number or a object([key: type]: number of connections).
Members `type` and `info` no longer belong to the plan's option, but belong to the plan object;
Only the task implemented ITask will been passed as a parameter to the plan's process function;
rewrite the timer callback and separated into some function;
adapt method `plan` to the support of different types;
publish the package as version 0.6.0;

0.5.7

Toggle 0.5.7's commit message
publish as version 0.5.7