celery -A proj report
ã®åºåãåé¡ã«å«ããŸãããsoftware -> celery:4.0.0 (latentcall) kombu:4.0.0 py:3.4.3
billiard:3.5.0.2 py-amqp:2.1.1
platform -> system:Linux arch:64bit, ELF imp:CPython
loader -> celery.loaders.default.Loader
settings -> transport:amqp results:disabled
master
ãã©ã³ãã«å¯ŸããŠååšããããšã確èªããŸãããåãä»æ§ãšèŠä»¶ãæã€ä»ã®ãã·ã³ãåäœããŠãããããæ£ç¢ºã«ã¯ããããŸããã
ã¿ã¹ã¯ãæ¶è²»ããå¿ èŠããããŸãã
ã¿ã¹ã¯ãåãå ¥ãããããã¬ãŒã¹ããã¯ããã°ã«èšé²ãããäœããã®çç±ã§ã¯ãŒã«ãŒããããŒã«ãŒã«åæ¥ç¶ããŸãã ããã¯æ°žé ã«ç¹°ãè¿ãããŸãïŒ
[2016-11-23 23:09:00,468: INFO/MainProcess] Connected to amqp://user:**@10.136.131.6:5672//
[2016-11-23 23:09:00,484: INFO/MainProcess] mingle: searching for neighbors
[2016-11-23 23:09:01,921: INFO/MainProcess] mingle: sync with 1 nodes
[2016-11-23 23:09:01,922: INFO/MainProcess] mingle: sync complete
[2016-11-23 23:09:01,970: INFO/MainProcess] Received task: tasks.calculate_user_running_total[ddd103af-d527-4564-83f8-96b747767a0c]
[2016-11-23 23:09:01,972: CRITICAL/MainProcess] Unrecoverable error: TypeError("'NoneType' object is not callable",)
Traceback (most recent call last):
File "./venv/lib/python3.4/site-packages/celery/worker/worker.py", line 203, in start
self.blueprint.start(self)
File "./venv/lib/python3.4/site-packages/celery/bootsteps.py", line 119, in start
step.start(parent)
File "./venv/lib/python3.4/site-packages/celery/bootsteps.py", line 370, in start
return self.obj.start()
File "./venv/lib/python3.4/site-packages/celery/worker/consumer/consumer.py", line 318, in start
blueprint.start(self)
File "./venv/lib/python3.4/site-packages/celery/bootsteps.py", line 119, in start
step.start(parent)
File "./venv/lib/python3.4/site-packages/celery/worker/consumer/consumer.py", line 584, in start
c.loop(*c.loop_args())
File "./venv/lib/python3.4/site-packages/celery/worker/loops.py", line 47, in asynloop
consumer.consume()
File "./venv/lib/python3.4/site-packages/kombu/messaging.py", line 470, in consume
self._basic_consume(T, no_ack=no_ack, nowait=False)
File "./venv/lib/python3.4/site-packages/kombu/messaging.py", line 591, in _basic_consume
no_ack=no_ack, nowait=nowait)
File "./venv/lib/python3.4/site-packages/kombu/entity.py", line 737, in consume
arguments=self.consumer_arguments)
File "./venv/lib/python3.4/site-packages/amqp/channel.py", line 1578, in basic_consume
wait=None if nowait else spec.Basic.ConsumeOk,
File "./venv/lib/python3.4/site-packages/amqp/abstract_channel.py", line 73, in send_method
return self.wait(wait, returns_tuple=returns_tuple)
File "./venv/lib/python3.4/site-packages/amqp/abstract_channel.py", line 93, in wait
self.connection.drain_events(timeout=timeout)
File "./venv/lib/python3.4/site-packages/amqp/connection.py", line 464, in drain_events
return self.blocking_read(timeout)
File "./venv/lib/python3.4/site-packages/amqp/connection.py", line 469, in blocking_read
return self.on_inbound_frame(frame)
File "./venv/lib/python3.4/site-packages/amqp/method_framing.py", line 88, in on_frame
callback(channel, msg.frame_method, msg.frame_args, msg)
File "./venv/lib/python3.4/site-packages/amqp/connection.py", line 473, in on_inbound_method
method_sig, payload, content,
File "./venv/lib/python3.4/site-packages/amqp/abstract_channel.py", line 142, in dispatch_method
listener(*args)
File "./venv/lib/python3.4/site-packages/amqp/channel.py", line 1613, in _on_basic_deliver
fun(msg)
File "./venv/lib/python3.4/site-packages/kombu/messaging.py", line 617, in _receive_callback
return on_m(message) if on_m else self.receive(decoded, message)
File "./venv/lib/python3.4/site-packages/celery/worker/consumer/consumer.py", line 558, in on_task_received
callbacks,
File "./venv/lib/python3.4/site-packages/celery/worker/strategy.py", line 145, in task_message_handler
handle(req)
File "./venv/lib/python3.4/site-packages/celery/worker/worker.py", line 221, in _process_task_sem
return self._quick_acquire(self._process_task, req)
File "./venv/lib/python3.4/site-packages/kombu/async/semaphore.py", line 62, in acquire
callback(*partial_args, **partial_kwargs)
File "./venv/lib/python3.4/site-packages/celery/worker/worker.py", line 226, in _process_task
req.execute_using_pool(self.pool)
File "./venv/lib/python3.4/site-packages/celery/worker/request.py", line 532, in execute_using_pool
correlation_id=task_id,
File "./venv/lib/python3.4/site-packages/celery/concurrency/base.py", line 155, in apply_async
**options)
File "./venv/lib/python3.4/site-packages/billiard/pool.py", line 1487, in apply_async
self._quick_put((TASK, (result._job, None, func, args, kwds)))
TypeError: 'NoneType' object is not callable
äžèšã®è¡ã¯æ°ç§ããšã«ç¹°ãè¿ããããã¥ãŒããã¿ã¹ã¯ãæ¶è²»ãããããšã¯ãããŸããã
Celeryã¯ãŒã«ãŒããŒã¢ã³ãã¯ã©ãã·ã¥ããŠããããããã°ã§ãšã©ãŒãç¹°ãè¿ãããŠãããããsystemdãããŒã¢ã³ãåèµ·åããŸãã
@ask ã self._quick_put
ã¯ã©ããããããå®çŸ©ãããŠããŸããã ããªã€ãŒãã¯ãåŒã³åºãåã«None
ã®å€ããã§ãã¯ããããäŸå€ããã£ããããå¿
èŠããããŸããããããšãself._quick_put
ãNone
ã«ãªãããšã¯ãããŸãããïŒ
billiard / pool.pyïŒL1483ãif self.threads or self._quick_put is None:
ã«å€æŽãããšãCeleryã¯ã¯ã©ãã·ã¥ããªããªããŸããããäœããã®çç±ã§ã¯ãŒã«ãŒãã¿ã¹ã¯ãåŠçããããšã¯ãããŸããã
ãã®ã³ã°ã¬ãã«DEBUGã«ãããã詳现ãªåºåïŒ
[2016-11-27 14:48:09,875: DEBUG/MainProcess] | Worker: Preparing bootsteps.
[2016-11-27 14:48:09,877: DEBUG/MainProcess] | Worker: Building graph...
[2016-11-27 14:48:09,878: DEBUG/MainProcess] | Worker: New boot order: {Timer, Hub, Pool, Autoscaler, StateDB, Beat, Consumer}
[2016-11-27 14:48:09,889: DEBUG/MainProcess] | Consumer: Preparing bootsteps.
[2016-11-27 14:48:09,889: DEBUG/MainProcess] | Consumer: Building graph...
[2016-11-27 14:48:09,898: DEBUG/MainProcess] | Consumer: New boot order: {Connection, Agent, Events, Mingle, Tasks, Control, Gossip, Heart, event loop}
[2016-11-27 14:48:09,908: DEBUG/MainProcess] | Worker: Starting Hub
[2016-11-27 14:48:09,908: DEBUG/MainProcess] ^-- substep ok
[2016-11-27 14:48:09,908: DEBUG/MainProcess] | Worker: Starting Pool
[2016-11-27 14:48:09,998: DEBUG/MainProcess] ^-- substep ok
[2016-11-27 14:48:09,999: DEBUG/MainProcess] | Worker: Starting Consumer
[2016-11-27 14:48:10,000: DEBUG/MainProcess] | Consumer: Starting Connection
[2016-11-27 14:48:10,016: DEBUG/MainProcess] Start from server, version: 0.9, properties: {'cluster_name': 'rabbit<strong i="6">@rabbitmq</strong>', 'product': 'RabbitMQ', 'version': '3.5.6', 'information': 'Licensed under the MPL.
See http://www.rabbitmq.com/', 'capabilities': {'authentication_failure_close': True, 'consumer_priorities': True, 'consumer_cancel_notify': True, 'per_consumer_qos': True, 'basic.nack': True, 'publisher_confirms': True, 'connection.blocked': True, 'exchange_exchange_bindings': True}, 'copyright': 'Copyright (C) 2007-2015 Pivotal Software, Inc.', 'platform': 'Erlang/OTP'}, mechanisms: ['AMQPLAIN', 'PLAIN'], locales: ['en_US']
[2016-11-27 14:48:10,018: INFO/MainProcess] Connected to amqp://user:**@10.136.131.6:5672//
[2016-11-27 14:48:10,018: DEBUG/MainProcess] ^-- substep ok
[2016-11-27 14:48:10,019: DEBUG/MainProcess] | Consumer: Starting Events
[2016-11-27 14:48:10,031: DEBUG/MainProcess] Start from server, version: 0.9, properties: {'cluster_name': 'rabbit<strong i="7">@rabbitmq</strong>', 'product': 'RabbitMQ', 'version': '3.5.6', 'information': 'Licensed under the MPL. See http://www.rabbitmq.com/', 'capabilities': {'authentication_failure_close': True, 'consumer_priorities': True, 'consumer_cancel_notify': True, 'per_consumer_qos': True, 'basic.nack': True, 'publisher_confirms': True, 'connection.blocked': True, 'exchange_exchange_bindings': True}, 'copyright': 'Copyright (C) 2007-2015 Pivotal Software, Inc.', 'platform': 'Erlang/OTP'}, mechanisms: ['AMQPLAIN', 'PLAIN'], locales: ['en_US']
[2016-11-27 14:48:10,034: DEBUG/MainProcess] ^-- substep ok
[2016-11-27 14:48:10,034: DEBUG/MainProcess] | Consumer: Starting Mingle
[2016-11-27 14:48:10,035: INFO/MainProcess] mingle: searching for neighbors
[2016-11-27 14:48:10,036: DEBUG/MainProcess] using channel_id: 1
[2016-11-27 14:48:10,041: DEBUG/MainProcess] Channel open
[2016-11-27 14:48:10,061: DEBUG/MainProcess] Start from server, version: 0.9, properties: {'cluster_name': 'rabbit<strong i="8">@rabbitmq</strong>', 'product': 'RabbitMQ', 'version': '3.5.6', 'information': 'Licensed under the MPL. See http://www.rabbitmq.com/', 'capabilities': {'authentication_failure_close': True, 'consumer_priorities': True, 'consumer_cancel_notify': True, 'per_consumer_qos': True, 'basic.nack': True, 'publisher_confirms': True, 'connection.blocked': True, 'exchange_exchange_bindings': True}, 'copyright': 'Copyright (C) 2007-2015 Pivotal Software, Inc.', 'platform': 'Erlang/OTP'}, mechanisms: ['AMQPLAIN', 'PLAIN'], locales: ['en_US']
[2016-11-27 14:48:10,063: DEBUG/MainProcess] using channel_id: 1
[2016-11-27 14:48:10,064: DEBUG/MainProcess] Channel open
[2016-11-27 14:48:11,189: INFO/MainProcess] mingle: sync with 3 nodes
[2016-11-27 14:48:11,190: DEBUG/MainProcess] mingle: processing reply from celery<strong i="9">@worker03</strong>
[2016-11-27 14:48:11,190: DEBUG/MainProcess] mingle: processing reply from celery<strong i="10">@worker02</strong>
[2016-11-27 14:48:11,190: DEBUG/MainProcess] mingle: processing reply from celery<strong i="11">@worker01</strong>
[2016-11-27 14:48:11,190: INFO/MainProcess] mingle: sync complete
[2016-11-27 14:48:11,191: DEBUG/MainProcess] ^-- substep ok
[2016-11-27 14:48:11,191: DEBUG/MainProcess] | Consumer: Starting Tasks
[2016-11-27 14:48:11,244: DEBUG/MainProcess] ^-- substep ok
[2016-11-27 14:48:11,244: DEBUG/MainProcess] | Consumer: Starting Control
[2016-11-27 14:48:11,244: DEBUG/MainProcess] using channel_id: 2
[2016-11-27 14:48:11,246: DEBUG/MainProcess] Channel open
[2016-11-27 14:48:11,251: DEBUG/MainProcess] ^-- substep ok
[2016-11-27 14:48:11,251: DEBUG/MainProcess] | Consumer: Starting Gossip
[2016-11-27 14:48:11,252: DEBUG/MainProcess] using channel_id: 3
[2016-11-27 14:48:11,253: DEBUG/MainProcess] Channel open
[2016-11-27 14:48:11,257: DEBUG/MainProcess] ^-- substep ok
[2016-11-27 14:48:11,258: DEBUG/MainProcess] | Consumer: Starting Heart
[2016-11-27 14:48:11,259: DEBUG/MainProcess] using channel_id: 1
[2016-11-27 14:48:11,260: DEBUG/MainProcess] Channel open
[2016-11-27 14:48:11,261: DEBUG/MainProcess] ^-- substep ok
[2016-11-27 14:48:11,261: DEBUG/MainProcess] | Consumer: Starting event loop
[2016-11-27 14:48:11,264: INFO/MainProcess] Received task: wakatime.tasks.cache_coding_activity[0eba267c-72e4-40ea-91dd-a1a7ab17c514]
[2016-11-27 14:48:11,265: DEBUG/MainProcess] TaskPool: Apply <function _fast_trace_task at 0x7ff469300950> (args:('wakatime.tasks.cache_coding_activity', '0eba267c-72e4-40ea-91dd-a1a7ab17c514', {'argsrepr': '()', 'task': 'wakatime.tasks.cache_coding_activity', 'lang': 'py', 'parent_id': '81f0c7ce-1396-496f-bf64-ae243736c845', 'timelimit': [None, None], 'root_id': '128647cc-f558-4b7d-bafc-338d186b5cfa', 'reply_to': 'e3c2b067-a058-3aa0-a3a1-384d4b917bbf', 'retries': 0, 'expires': None, 'delivery_info': {'exchange': '', 'priority': None, 'routing_key': 'cache', 'redelivered': True}, 'id': '0eba267c-72e4-40ea-91dd-a1a7ab17c514', 'correlation_id': '0eba267c-72e4-40ea-91dd-a1a7ab17c514', 'group': None, 'eta': None, 'kwargsrepr': "{'cache_projects': True, 'timeout': 15, 'user_id': UUID('d9c69ce0-f194-45a6-83cf-98f931fca8aa'), 'writes_only': False}", 'origin': 'gen3021<strong i="12">@worker02</strong>'}, '[[], {"cache_projects": true, "timeout": 15, "user_id": "d9c69ce0-f194-45a6-83cf-98f931fca8aa", "writes_only": false}, {"callbacks": null, "chain": null, "chord": null, "errbacks": null}]', 'application/json', 'utf-8') kwargs:{})
[2016-11-27 14:48:11,266: CRITICAL/MainProcess] Unrecoverable error: TypeError("'NoneType' object is not callable",)
Traceback (most recent call last):
File "./venv/src/celery/celery/worker/worker.py", line 203, in start
self.blueprint.start(self)
File "./venv/src/celery/celery/bootsteps.py", line 119, in start
step.start(parent)
File "./venv/src/celery/celery/bootsteps.py", line 370, in start
return self.obj.start()
File "./venv/src/celery/celery/worker/consumer/consumer.py", line 318, in start
blueprint.start(self)
File "./venv/src/celery/celery/bootsteps.py", line 119, in start
step.start(parent)
File "./venv/src/celery/celery/worker/consumer/consumer.py", line 593, in start
c.loop(*c.loop_args())
File "./venv/src/celery/celery/worker/loops.py", line 47, in asynloop
consumer.consume()
File "./venv/lib/python3.4/site-packages/kombu/messaging.py", line 470, in consume
self._basic_consume(T, no_ack=no_ack, nowait=False)
File "./venv/lib/python3.4/site-packages/kombu/messaging.py", line 591, in _basic_consume
no_ack=no_ack, nowait=nowait)
File "./venv/lib/python3.4/site-packages/kombu/entity.py", line 737, in consume
arguments=self.consumer_arguments)
File "./venv/lib/python3.4/site-packages/amqp/channel.py", line 1578, in basic_consume
wait=None if nowait else spec.Basic.ConsumeOk,
File "./venv/lib/python3.4/site-packages/amqp/abstract_channel.py", line 73, in send_method
return self.wait(wait, returns_tuple=returns_tuple)
File "./venv/lib/python3.4/site-packages/amqp/abstract_channel.py", line 93, in wait
self.connection.drain_events(timeout=timeout)
File "./venv/lib/python3.4/site-packages/amqp/connection.py", line 464, in drain_events
return self.blocking_read(timeout)
File "./venv/lib/python3.4/site-packages/amqp/connection.py", line 469, in blocking_read
return self.on_inbound_frame(frame)
File "./venv/lib/python3.4/site-packages/amqp/method_framing.py", line 88, in on_frame
callback(channel, msg.frame_method, msg.frame_args, msg)
File "./venv/lib/python3.4/site-packages/amqp/connection.py", line 473, in on_inbound_method
method_sig, payload, content,
File "./venv/lib/python3.4/site-packages/amqp/abstract_channel.py", line 142, in dispatch_method
listener(*args)
File "./venv/lib/python3.4/site-packages/amqp/channel.py", line 1613, in _on_basic_deliver
fun(msg)
File "./venv/lib/python3.4/site-packages/kombu/messaging.py", line 617, in _receive_callback
return on_m(message) if on_m else self.receive(decoded, message)
File "./venv/src/celery/celery/worker/consumer/consumer.py", line 567, in on_task_received
callbacks,
File "./venv/src/celery/celery/worker/strategy.py", line 145, in task_message_handler
handle(req)
File "./venv/src/celery/celery/worker/worker.py", line 221, in _process_task_sem
return self._quick_acquire(self._process_task, req)
File "./venv/lib/python3.4/site-packages/kombu/async/semaphore.py", line 62, in acquire
callback(*partial_args, **partial_kwargs)
File "./venv/src/celery/celery/worker/worker.py", line 226, in _process_task
req.execute_using_pool(self.pool)
File "./venv/src/celery/celery/worker/request.py", line 532, in execute_using_pool
correlation_id=task_id,
File "./venv/src/celery/celery/concurrency/base.py", line 155, in apply_async
**options)
File "./venv/lib/python3.4/site-packages/billiard/pool.py", line 1487, in apply_async
self._quick_put((TASK, (result._job, None, func, args, kwds)))
TypeError: 'NoneType' object is not callable
[2016-11-27 14:48:11,273: DEBUG/MainProcess] | Worker: Closing Hub...
[2016-11-27 14:48:11,274: DEBUG/MainProcess] | Worker: Closing Pool...
[2016-11-27 14:48:11,274: DEBUG/MainProcess] | Worker: Closing Consumer...
[2016-11-27 14:48:11,274: DEBUG/MainProcess] | Worker: Stopping Consumer...
[2016-11-27 14:48:11,274: DEBUG/MainProcess] | Consumer: Closing Connection...
[2016-11-27 14:48:11,275: DEBUG/MainProcess] | Consumer: Closing Events...
[2016-11-27 14:48:11,275: DEBUG/MainProcess] | Consumer: Closing Mingle...
[2016-11-27 14:48:11,275: DEBUG/MainProcess] | Consumer: Closing Tasks...
[2016-11-27 14:48:11,275: DEBUG/MainProcess] | Consumer: Closing Control...
[2016-11-27 14:48:11,275: DEBUG/MainProcess] | Consumer: Closing Gossip...
[2016-11-27 14:48:11,276: DEBUG/MainProcess] | Consumer: Closing Heart...
[2016-11-27 14:48:11,276: DEBUG/MainProcess] | Consumer: Closing event loop...
[2016-11-27 14:48:11,276: DEBUG/MainProcess] | Consumer: Stopping event loop...
[2016-11-27 14:48:11,276: DEBUG/MainProcess] | Consumer: Stopping Heart...
[2016-11-27 14:48:11,277: DEBUG/MainProcess] | Consumer: Stopping Gossip...
[2016-11-27 14:48:11,278: INFO/MainProcess] Received task: wakatime.tasks.cache_coding_activity[f786fc75-0518-4893-8988-ff7f063edd12]
[2016-11-27 14:48:11,278: DEBUG/MainProcess] TaskPool: Apply <function _fast_trace_task at 0x7ff469300950> (args:('wakatime.tasks.cache_coding_activity', 'f786fc75-0518-4893-8988-ff7f063edd12', {'argsrepr': '()', 'task': 'wakatime.tasks.cache_coding_activity', 'lang': 'py', 'parent_id': '81f0c7ce-1396-496f-bf64-ae243736c845', 'timelimit': [None, None], 'root_id': '128647cc-f558-4b7d-bafc-338d186b5cfa', 'reply_to': 'e3c2b067-a058-3aa0-a3a1-384d4b917bbf', 'retries': 0, 'expires': None, 'delivery_info': {'exchange': '', 'priority': None, 'routing_key': 'cache', 'redelivered': True}, 'id': 'f786fc75-0518-4893-8988-ff7f063edd12', 'correlation_id': 'f786fc75-0518-4893-8988-ff7f063edd12', 'group': None, 'eta': None, 'kwargsrepr': "{'cache_projects': True, 'timeout': 15, 'user_id': UUID('7056644f-2564-4074-b89e-631973879f44'), 'writes_only': False}", 'origin': 'gen3021<strong i="13">@worker02</strong>'}, '[[], {"cache_projects": true, "timeout": 15, "user_id": "7056644f-2564-4074-b89e-631973879f44", "writes_only": false}, {"callbacks": null, "chain": null, "chord": null, "errbacks": null}]', 'application/json', 'utf-8') kwargs:{})
[2016-11-27 14:48:11,279: INFO/MainProcess] Received task: wakatime.tasks.cache_coding_activity[d5c8dc57-116c-467d-9924-e2999280c2f8]
[2016-11-27 14:48:11,280: INFO/MainProcess] Received task: wakatime.tasks.cache_coding_activity[460ef864-e482-4b0f-8580-d0095750bae6]
[2016-11-27 14:48:11,281: DEBUG/MainProcess] Closed channel #3
[2016-11-27 14:48:11,281: DEBUG/MainProcess] | Consumer: Stopping Control...
[2016-11-27 14:48:11,283: DEBUG/MainProcess] Closed channel #2
[2016-11-27 14:48:11,283: DEBUG/MainProcess] | Consumer: Stopping Tasks...
[2016-11-27 14:48:11,284: DEBUG/MainProcess] Canceling task consumer...
[2016-11-27 14:48:11,286: DEBUG/MainProcess] | Consumer: Stopping Mingle...
[2016-11-27 14:48:11,286: DEBUG/MainProcess] | Consumer: Stopping Events...
[2016-11-27 14:48:11,286: DEBUG/MainProcess] | Consumer: Stopping Connection...
[2016-11-27 14:48:11,286: DEBUG/MainProcess] | Worker: Stopping Pool...
[2016-11-27 14:48:12,800: DEBUG/MainProcess] result handler: all workers terminated
[2016-11-27 14:48:12,801: DEBUG/MainProcess] | Worker: Stopping Hub...
[2016-11-27 14:48:12,801: DEBUG/MainProcess] | Consumer: Shutdown Heart...
[2016-11-27 14:48:12,802: DEBUG/MainProcess] | Consumer: Shutdown Gossip...
[2016-11-27 14:48:12,802: DEBUG/MainProcess] | Consumer: Shutdown Control...
[2016-11-27 14:48:12,802: DEBUG/MainProcess] | Consumer: Shutdown Tasks...
[2016-11-27 14:48:12,803: DEBUG/MainProcess] Canceling task consumer...
[2016-11-27 14:48:12,803: DEBUG/MainProcess] Closing consumer channel...
[2016-11-27 14:48:12,803: DEBUG/MainProcess] | Consumer: Shutdown Events...
[2016-11-27 14:48:12,804: DEBUG/MainProcess] Closed channel #1
[2016-11-27 14:48:12,805: DEBUG/MainProcess] | Consumer: Shutdown Connection...
[2016-11-27 14:48:12,806: DEBUG/MainProcess] Closed channel #1
[2016-11-27 14:48:12,807: DEBUG/MainProcess] removing tasks from inqueue until task handler finished
ããã¯Celery4.xã§å°å
¥ãããŸãããããã¯ã 3.1.24
ã«ããŠã³ã°ã¬ãŒããããšãã¬ãŒã¹ããã¯ãé²æ¢ãããããã§ãã
LinuxPython3.4ã§ã¯ããã§ã¯èµ·ãããŸããã ã¯ãŒã«ãŒãéå§ããããã«äœ¿çšããåŒæ°ã¯äœã§ããïŒ
_quick_putã¯æ±ºããŠNoneã§ãã£ãŠã¯ãªããŸããã ããã¯èµ·åæã§ããããããšãåžžã«æ¥ç¶é害ã®åŸã«çºçããŸããïŒ
ã¿ã¹ã¯ã®å®è¡äžã«ãããŒã«ãŒãåæ¢ããŠåçŸããããšããŸãããããŸã åçŸã§ããŸããã
åžžã«èµ·åæã ã¯ãŒã«ãŒã®åŒæ°ã¯æ¬¡ã®ãšããã§ãã
/opt/app/venv/bin/python /opt/app/venv/bin/celery worker --app=wakatime.celery --workdir=/opt/app --logfile=/var/log/celery/worker.log --loglevel=INFO --concurrency=50 --exclude-queues=medium,low,cache
ãã®ããã®ðã 4.0.1ã§ãããŸã£ããåãåé¡ãçºçããŸã
@askã¯ãŒã«ãŒãèµ·åãããšãã«åŠçãããã®ãåŸ ã£ãŠãããããŒã«ãŒäžã®ã¡ãã»ãŒãžããããšãã¯ãã€ã§ãããããåçŸããããšãã§ããŸãã ããã¯ãããŒãã䜿çšããå Žåã«ããããããšã§ãããç§ã®å Žåã§ãã ããŒããµãŒãã¹ãã¯ãŒã«ãŒã®åã«ãªã³ã©ã€ã³ã«ãªããšãäžèšã®åé¡ã®ããã«ã¯ãŒã«ãŒãèµ·åã§ããªããªããŸãã ç§ã¯ãã¹ãŠã®ããšã«ã€ããŠPython2.7ã䜿çšããŠããããããäžè²«ããŠåçŸããããšãã§ããŸãã
ããã¯ïŒ3539ã§è¿°ã¹ããã®ãšåããšã©ãŒã§ã
@jmesquitaã¯ç§ã®ã·ããªãªãšäžèŽããŠããŸããããã¯ãã¯ãŒã«ãŒãéå§ãããšãã«ããããŒã«ãŒã§åžžã«ãã¥ãŒã«ä¿çäžã®ã¡ãã»ãŒãžãããããã§ãã
@alanhamlettãããä¿®æ£ããŠã³ãŒããèªã¿åãããšããŠããŸãããã»ããªã¯åããŠãªã®ã§ããã°ããæéããããå ŽåããããŸãã ç§ã«ãšã£ãŠå¥åŠãªã®ã¯ãã»ããªãšã»ããªã®ã¡ãã»ãŒãžã䜿çšããå€ãã®äººã ãããã©ã«ãã§åŽåè ã®ãã¥ãŒã«å ¥ããããŠããããããããã³ãã¥ããã£å ã§ççºçã«å¢å ããŠããªãããšã§ãã ã©ãããããã誀çšããŠããã®ã§ã¯ãªãããšæããŸãã
ã³ãŒããå°ãæãäžããŠã¿ããšã _quick_put
ã¯AsyncPool._create_write_handlers
ã«ãã£ãŠå²ãåœãŠããã AsyncPool.register_with_event_loop
ã«ãã£ãŠåŒã³åºããã celery.worker.loops.asynloop
ã«ãã£ãŠåŒã³åºãããŸãã è¡šé¢çã«ã¯ãåé¡ã¯asynloop
ãæåã«consumer.consume()
ãåŒã³åºãã次ã«obj.register_with_event_loop
ãåŒã³åºãããšã§ããããã«èŠããŸããããã«ããã _quick_put
ãNone
ã«ãªãconsume()
å
ããåŒã³åºãããŸãã
ããã¯ãã€ãã³ãã«ãŒãã®éå§æã«ãã¥ãŒã«ã¡ãã»ãŒãžããªãå Žåã«åé¡ãçºçããªãçç±ã説æããŸããããã¯ã consume()
ã¯äœãè¡ããã次ã«åŒã³åºããããšãã«register_with_event_loop
ãåŒã³åºãããããã§ãããã§ã«åŒã³åºãããŠããŸãã
移åããããšã§ãããä¿®æ£ã§ããŸã
obj.controller.register_with_event_loop(hub)
obj.register_with_event_loop(hub)
consumer.consume()
ã®åã§ãããããã¯ãã¡ããéåžžã«åçŽãªïŒãããŠããããééã£ãïŒä¿®æ£ã«ãããŸããã
ããã§ãã»ããªã®ããŒãã¡ãã»ãŒãžãäžæçã«ããããšã§åé¡ãåé¿ããŸãããããã¯ããšã«ããç§ã®æå³ããåäœã§ãã Celeryãšãã®ã³ãŒãããŒã¹ã®çµéšãå°ãå¢ããããããã«ãããåæ€èšããŸãã
@jmesquita ïŒ
ããã§ãã»ããªã®ããŒãã¡ãã»ãŒãžãäžæçã«ããããšã§åé¡ãåé¿ããŸãã
ããã«ããããšã©ãŒãçºçããªããªããŸãã ææ¡ããããšãããããŸãã
ãã®ãã°ãåçŸã§ããã®ã¯ãè€æ°ã®ãã¥ãŒããæ¶è²»ããããšããŠããå Žåã®ã¿ã§ãã ãã¹ãŠãåäžã®ãã¥ãŒããæ¶è²»ãããå Žåãèµ·åã¯æåŸ ã©ããã«æ©èœããŸãïŒãã¥ãŒäžã®ã¡ãã»ãŒãžã¯é©åã«æ¶è²»ãããŸãïŒã
@adewesç§ã¯ããªãã®ææ¡ãã解決çããã¹ãããŸããããããŠå°ãªããšãè¡šé¢çã«ã¯ããã¯åé¡ã解決ããããã§ãã
@adewesææ¡ãããå€æŽã«ã€ããŠè©±ãåãããšãã§ããããã«ããã«ãªã¯ãšã¹ããçºè¡ã§ããŸããïŒ
ãã®åé¡ã«é¢ããæŽæ°ã¯ãããŸããïŒ ããã¯ãçç£ãå«ããçŸåšç§ãã¡ã«å€§ããªåé¡ãåŒãèµ·ãããŠããŸãã TypeError
ã®åé¡ãçºçãããããããŒã«ã«ã§ãã¹ãããããšãã§ããŸããã Celery3ã«ããŠã³ã°ã¬ãŒãããå¿
èŠãããå ŽåããããŸãã
ç§ã¯ä»ã®ãšããããã解決ããããšãã§ããŸããã§ããããŸãä»ã®ãšããããŒãžã§ã³3ã«ããŠã³ã°ã¬ãŒããããŸãããåé¡ãããã«ä¿®æ£ãããããšãé¡ã£ãŠããŸãã @thedrowç§ã®ãã¯ã€ãã¯ãã£ãã¯ã¹ãã§ã¯åé¡ã®å®å šãªè§£æ±ºçãåŸãããªãã£ãããããã«ãªã¯ãšã¹ããéããŠããŸããã ç§ã¯äœ¿çšãããŠããã³ã³ããŒãã³ãã®ããŒã¿ãããŒã«å®å šã«ç²ŸéããŠããªãããïŒããã§ã¯ããã€ãã®ã©ã€ãã©ãªã䜿çšãããŠããŸãïŒãæ®å¿µãªããçŸåšãããããã«ãããã°ããããšã¯ã§ããŸããã
v2ã¿ã¹ã¯èšèšã§ã®ã¡ãã»ãŒãžããããŒã®æ°ãã䜿çšæ³ã«äŸåããŠããå¯èœæ§ããããããå®éã«ããŠã³ã°ã¬ãŒãã§ãããã©ããããããããŸããã
@ ask--ãããã°ã«åœ¹ç«ã€æ£ç¢ºãªç°å¢ã確èªã§ããããã«ãç»é¢å ±æãªã©ãåãã§æäŸããŸããå¿ èŠã«å¿ããŠããªã¢ãŒããããã°ãéããŠã¿ãŠãã ããã ç§ãã¡ã¯Celery4ã«å šé¢çã«åå ããçŸåšã¯åŽåè ã®çç£ãéå§ã§ããªããããå°ãææãããŠããŸãã
ä»ã®ãšãããç§ã®ãã©ãŒã¯ãã€ã³ã¹ããŒã«ããŠãæ¬çªç°å¢ã§åäœãããããšãã§ããŸãã
pip install -e git://github.com/alanhamlett/celery.git@73147a9da31f2932eb4778e9474fbe72f23d21c2#egg=Celery
ãããä¿®æ£ããããã«ïŒ3752ãéãããšããã§ãããæåã«ãã°ãã«ããŒããããã®é©åãªãã¹ããèŠã€ããå¿ èŠããããŸãã
æ¬åœã«ããããšãã
ç§ã¯å€¢äžã«ãªã£ãŠãããšæãå§ããŸãã...4.0.2ïŒçŸåšã¯4.0.0ïŒã«ã¢ããã°ã¬ãŒãããããšããŸãããããã®ã¢ããã°ã¬ãŒãã§ãçªç¶ã®self.retry()
ããã¹ãŠæ©èœããªããªããŸããã
CLIã§æ瀺çã«ãã¥ãŒãæå®ããããšã¯ããŠã©ãŒã¯ã¢ã©ãŠã³ãã®ããã«èŠããŸãïŒ4.0.0ã®å ŽåïŒ
CLIã§ãã¥ãŒãæ瀺çã«æå®ããŸãã ãŸã åé¡ããããŸããã
2017幎1æ13æ¥éææ¥åå5æ35åãKarol [email protected]
æžããŸããïŒ
CLIã§æ瀺çã«ãã¥ãŒãæå®ããããšã¯ããŠã©ãŒã¯ã¢ã©ãŠã³ãã®ããã«èŠããŸãïŒ
4.0.0ïŒâ
ã³ã¡ã³ãããã®ã§ãããåãåã£ãŠããŸãã
ãã®ã¡ãŒã«ã«çŽæ¥è¿ä¿¡ããGitHubã§è¡šç€ºããŠãã ãã
https://github.com/celery/celery/issues/3620#issuecomment-272412258 ããŸãã¯ãã¥ãŒã
ã¹ã¬ãã
https://github.com/notifications/unsubscribe-auth/ABRHQSzvyRcQI5qvfufNwPJvXNElcQKPks5rR1NggaJpZM4K7LEz
ã
@jdotjdot-ç§ã¯åãããšãèŠãŠããŸãã ã³ãã³ãã©ã€ã³ã§ã®ãã¥ãŒã®æå®ã
ãã¥ãŒã«ããŒã¿ãããå Žåã«ã®ã¿åé¡ãçºçããŸãã ãã¥ãŒã空ã®å Žåãã¯ãŒã«ãŒãèµ·åããŠå®è¡ã§ããŸãã
+1
ãã®æ£ç¢ºãªåé¡ããããŸãã å¯äžã®è§£æ±ºçã¯ç§ã®ãããŒã«ãŒããªã»ããããããã§ãïŒããã¯ãã¥ãŒã«ã¯é©ããŠããŸããïŒã
+1
ãã®åŸãïŒ3773ãåºæ¬æ©èœã®æ¬ åŠãããã³é床ã®è€éãç§ã¯ããããCeleryãhttps://github.com/closeio/tasktigerã«çœ®ãæããŸãã 誰ããïŒ3752ãåŒãç¶ãããã§ããïŒ å¿ èŠãªã®ã¯ãåé¡ãã«ããŒããããã®ãã¹ããäœæããããšã ãã§ãã
@alanhamlett tasktigerãç¥ããŸããã§ããããææã«èŠããŸãã ãããã©ãã»ã©æçããŠããŠãå®å®ããŠããŠãä¿¡é Œã§ãããç¥ã£ãŠããŸããïŒ ç§ã¯éåžžããã€ã¯ããã¬ãŒã ã¯ãŒã¯ã®å€§ãã¡ã³ã§ãããCeleryã¯å€§ããæé·ããããã€ãã®å€éšäŸåé¢ä¿ãšPython3ãžã®åãæ¿ãããããŸã...ïŒå°ãªããšãç§ã®å±éã§ã¯ïŒç©äºãå¶åŸ¡äžèœã«ãªã£ãŠããããã§ãã
PRïŒ3752ã«ãã§ã«ä¿®æ£ãããããšãèãããšãããããªãªãŒã¹ããèšç»ã¯äœã§ããïŒ ããã¯ãå®çšŒåç°å¢ã§Celery 4.xã䜿çšã§ããªããªããããé倧ãªãã°ã§ããããšã«æ³šæããŠãã ããã ä¿çäžã®ã¡ãã»ãŒãžãå ¥ã£ãŠãããããšãã£ãŠãã¯ãŒã«ãŒãæ»ãªããããšã¯ã§ããŸããã
ãããçµ±åãããã®ãèŠãã
åŽåè ã®åãæ§è³ªãã»ããªã«ãšã£ãŠéåžžã«åºæ¬çã§ããããããããããåªå ããã«å€ããä»ã®åé¡ãå€ããããšã¯æ³åã§ããŸããã ããã¯ç§ãã¡ãProdã«è¡ãã®ã劚ããå¯äžã®ããšã§ãã 誰ããããããã€å¯ŸåŠããããã«ã€ããŠã®èŠç©ãããæã£ãŠããŸããïŒ
@johnatronç§ã¯åãããšãèããŸããããProdã«æ°ããå°å ¥ãããä»ã®è€æ°ã®ãã°ã«ééããŸããã ããŠã³ã°ã¬ãŒãããå¿ èŠããããŸããããã¡ãã»ãŒãžã³ã°ä»æ§ã3.xãš4.xã®éã§äºææ§ããªããããããã¯å°é£ã§ãã ãŸããtasktigerã®ãããªCeleryã®ä»£æ¿æ¡ãæ€èšããŸããã Prodã®Celery4.xxã«æ³šæããŠãã ããã
ã¡ãã»ãŒãžä»æ§ã¯ãææ°ããŒãžã§ã³ã®3.xãšçžäºäºææ§ããããŸãã
ç§ã¯ããã察åŠãããŠããªãããšã«ããªãé©ããŠããããšãèªããŸãã 䜿ã£ãŠããŸã
çŸåšçç£äžã®ã¢ã©ã³ã®ãã©ãŒã¯ã
2017幎2æ13æ¥æææ¥ååŸ2æ5åãAlan [email protected]
æžããŸããïŒ
@johnatron https://github.com/johnatronåãããšãèããŸãããã
Prodã§æ°ããå°å ¥ãããä»ã®è€æ°ã®ãã°ã«ééããŸããã ããŠã³ã°ã¬ãŒãããå¿ èŠããããŸããã
ã¡ãã»ãŒãžã³ã°ä»æ§ã¯3.xéã§äºææ§ããªããããããã¯å°é£ã§ãã
ããã³4.xã ãŸããtasktigerã®ãããªCeleryã®ä»£æ¿åãæ€èšãããŠãããŸãã
https://github.com/closeio/tasktiger ã ã®Celery4.xxã«æ³šæããŠãã ãã
補åâ
ããªããèšåãããã®ã§ãããªãã¯ãããåãåã£ãŠããŸãã
ãã®ã¡ãŒã«ã«çŽæ¥è¿ä¿¡ããGitHubã§è¡šç€ºããŠãã ãã
https://github.com/celery/celery/issues/3620#issuecomment-279489134 ããŸãã¯ãã¥ãŒã
ã¹ã¬ãã
https://github.com/notifications/unsubscribe-auth/ABRHQZkHixjDu37IA7PbAW6iJYcVTGevks5rcKligaJpZM4K7LEz
ã
ãã®äžå¹žãªé
ããèæ
®ããŠãç§ã¯æ¢ç¥ã®Celery4ã®åé¡ã«å¯Ÿããããã€ãã®ä¿®æ£ãgit+http://github.com/Eugeny/celery#egg=celery==4.0.2.1
ã«ããŒãžããããšã«ããŸããã
ãããïŒ
django-celery-beat
ã¹ã±ãžã¥ãŒã«ã®ä¿®æ£ããªããŒããããªããããŸã§ã®ãšãããæ¬çªç°å¢ã§æ£åžžã«æ©èœããŠããŸã
ã¡ãã»ãŒãžä»æ§ã¯çžäºäºææ§ããããããããŸããããCelery Canvasãšãã§ãŒã³ïŒç§ãã¡ããã䜿çšããæ©èœïŒã«é¢ããŠã¯ãããŒãžã§ã³éã«ïŒåŸ®åŠãªïŒäºææ§ã®ãªãéãããããŸãã ã¢ããªãv3ããv4ã«ç§»æ€ããããã«ããªãã®åŽåãè²»ããããŸããã æ»ããªããã°ãªããªãã®ã¯æªãææã§ãã
ããããã©ããžã¥ã¹ã®æ¥ïŒ ããããšãã
Python3.6ãšcelery4.0.2ã䜿çšããŠãåãåé¡ãçºçããŸãã
ã»ããªãã·ã£ããããŠã³ããã¿ã¹ã¯ãäœæããã»ããªãèµ·åãããšãããã«ãšã©ãŒTypeError: 'NoneType' object is not callable
ãçºçããŸãã @askææ¡ãããä¿®æ£ãšããŒãžã«ã€ããŠæ€èšããŠããã ããŸããïŒ ããã«ããã以åã¯æºè¶³ããŠããCeleryã®ãŠãŒã¶ãŒãCeleryã䜿ãç¶ããããšãã§ããªããªããŸã:(
ãæéãããã ãããããšãããããŸãã@ askïŒ
ãMicrosoftWindowsã¯ãµããŒããããªããªããŸããã
ãã¹ãã¹ã€ãŒãã¯åæ Œã§ãããCeleryã¯Windowsã§åäœããŠããããã§ããããã®ãã©ãããã©ãŒã ã§åé¡ã蚺æã§ããªããããä¿èšŒã¯ã§ããŸããã ãã®ãã©ãããã©ãŒã ã§ã®ãµããŒããå¿
èŠãªäŒæ¥ã®å Žåã¯ããé£çµ¡ãã ãããã
ããããä¿®æ£ãããããšã¯ãªãã§ãããã
@tiptoetttããã¯Windowsã«åºæã®åé¡ã§ã¯ãããŸããã ç§ã¯Macã䜿çšããŠããŸãã çããã®ã³ã¡ã³ããããèŠãŠããã ããŸãããïŒ ãã®ãããéçºè ã¯CeleryãæšãŠãã§ãããã ç§ã¯ã»ããªã5幎é䜿çšããŠããŸãããããã¯å€§ããªåé¡ã§ãã ãã®åé¡ããªãå Žåã¯ã以åã®ããŒãžã§ã³3.1.25ã䜿çšããŸãã
ãã®åé¡ããããŸã
lpiner<strong i="6">@host</strong>:~$ uname -a
Linux host 4.4.0-72-generic #93-Ubuntu SMP Fri Mar 31 14:07:41 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
lpiner<strong i="9">@host</strong>:~$ celery --version
4.0.2 (latentcall)
ããã¯ãåé¡ãåŒãèµ·ãããŠãããšæãããã³ãŒãè¡ã§ãã
task_queues = (
Queue('queue1_name', Exchange('default'), routing_key='default'),
Queue('queue2_name', Exchange('default'), routing_key='general.routing_key'),
)
2çªç®ã®ãã¥ãŒãåé€ãããšãåé¡ã¯è§£æ±ºããŸãã
@ChillarAnandã®celery/kombu / issues / 675ã®æçš¿ããç§ãç解ããŠããããšããããã®åé¡ã¯4.0.3ã§è§£æ±ºãããã¯ãã§ãããïŒ
ãã¹ã¿ãŒãã©ã³ããããã«ããéå§ããŠä»¥æ¥ããã®åé¡ã¯çºçããŠããŸããã
2017幎5æ8æ¥ååŸ5æ58åããVictorã [email protected]ã¯æ¬¡ã®ããã«æžããŠããŸãã
@ChillarAnandããç§ãç解ããŠããããšãã
https://github.com/ChillarAnandã®celery/kombuïŒ675ãžã®æçš¿
https://github.com/celery/kombu/issues/675 ããã®åé¡ã¯è§£æ±ºããå¿ èŠããããŸã
4.0.3ãŸã§ã«ãïŒâ
ã³ã¡ã³ãããã®ã§ãããåãåã£ãŠããŸãã
ãã®ã¡ãŒã«ã«çŽæ¥è¿ä¿¡ããGitHubã§è¡šç€ºããŠãã ãã
https://github.com/celery/celery/issues/3620#issuecomment-300002736 ããŸãã¯ãã¥ãŒã
ã¹ã¬ãã
https://github.com/notifications/unsubscribe-auth/AC3sA400hzoX7V0GUrUSfYmry9SZ8eIRks5r34_pgaJpZM4K7LEz
ã
ãããã§ãããã¯ããŸããããŸããïŒ
RabbitMQã䜿çšããCelery3.1.23ïŒCipaterïŒã§ãåãåé¡ãçºçããŸããã é·ããããã°ã®åŸãç§ã¯ã€ãã«ãã®ã¹ã¬ãããèŠã€ãã3.1.25ããŒãžã§ã³ã䜿çšããŠåé¡ãä¿®æ£ããŸããã ããããããã¯æ¬åœã«å£ã«é ãã¶ã€ããŠããŸããã
è€æ°ã®ãã¥ãŒãšããŒãããŒãã䜿çšããv4.0.2 (latentcall)
ã§ã®åãåé¡ã
v0.4.0.2
ã®åé¿çã«é¢ããåãåé¡ã¯ã v3.x
ã«ããŠã³ã°ã¬ãŒããããŸã
v4.0.2
ç§ã«ãšã£ãŠããã®åé¡ã¯ç®ãèŠåŒµããã®ã§ãã 3.xãžã®ããŠã³ã°ã¬ãŒãã¯æ€èšããŠããŸããã æ°ããããŒãžã§ã³ãããã«ãªãªãŒã¹ãããããšãé¡ã£ãŠããŸãã
@ba1drã¯ãã¹ã¿ãŒãããã«ãããŸãã ããã¯ç§ã®ããã«ãããä¿®æ£ããŸãã
@LPiner ãããããšããããã¯ç§ã®ããã®åé¡ãä¿®æ£ããŸããã ããããããã¯æ¬çªç°å¢ã«å¯Ÿå¿ãããœãªã¥ãŒã·ã§ã³ã§ã¯ãããŸãããã
@ba1drã¯TBHã®éžæè¢ãšããŠã¯ããŸããããŸããã ãããã3.xã«ããŠã³ã°ã¬ãŒãããŸãã
ç§ãã¡ã¯åé¡ãªãæ¬çªç°å¢ã§äœ¿çšããŠããŸãããç§ãã¡ã®èŠæš¡ã¯1æ¥ããããããæ°çŸã®ä»äºã§ãããããªãã®ãã€ã¬ãŒãžã¯ç°ãªãå ŽåããããŸãã
ãŸããªããªãªãŒã¹ããŸãã ïŒ4109ãåç §
ããã§ã圱é¿ãåããŸãã ãã ç§ãã¡ãæã€ã ãªãªãŒã¹ã®æºåãã§ããŸããïŒ
æãåèã«ãªãã³ã¡ã³ã
ãã®ããã®ðã 4.0.1ã§ãããŸã£ããåãåé¡ãçºçããŸã