您好,尊敬的作者,我如何判断爬虫已经运行结束,重新给他分配任务URL Hello, respect of the author, how can I determine whether the crawler has run over, back to his assigned tasks URL