Ipython: 深度重新加载会引发NonImplementedError

嗡嗡声， types和deeprelaod是相当黑暗的魔法。 我们可能需要将某些模块列入黑名单。

您想尝试PR吗？

您想尝试PR吗？

抱歉，我不知道发生了什么事。

抱歉，我不知道发生了什么事。

别担心。 我们来看一下！ 谢谢。

@Carreau ，即使types应该像＃10318一样被明确排除，我仍然在6.1.0中看到此问题。 有什么想法吗？ 我的python版本是3.6.2。

我还在6.2.1中看到了这一点

哼，很高兴能重新打开，但我无法在全新安装中进行复制，因此调试时会遇到问题：

$ ipython
Python 3.6.3 | packaged by conda-forge | (default, Oct  5 2017, 19:18:17)
Type 'copyright', 'credits' or 'license' for more information
IPython 6.2.1 -- An enhanced Interactive Python. Type '?' for help.

In [1]: import types

In [2]: from IPython.lib.deepreload import reload

In [3]: reload(types)
Out[3]: <module 'types' from '/Users/bussonniermatthias/anaconda/lib/python3.6/types.py'>

你们都有完全相同的回溯吗？

您提供的示例实际上适合我。 但是，我无法重新加载其他软件包（例如json ）：

Python 3.6.2 (default, Jul 24 2017, 19:47:39) 
Type 'copyright', 'credits' or 'license' for more information
IPython 6.2.1 -- An enhanced Interactive Python. Type '?' for help.

In [1]: import json

In [2]: from IPython.lib.deepreload import reload

In [3]: reload(json)
Reloading json.decoder
Reloading re
Reloading enum
Reloading types
Reloading functools
Reloading _functools
Reloading abc
Reloading _weakrefset
Reloading _weakref
Reloading collections
Reloading _collections_abc
Reloading operator
Reloading _operator
Reloading keyword
Reloading heapq
Reloading _heapq
Reloading importlib
Reloading _imp
Reloading _frozen_importlib
Reloading _frozen_importlib_external
Reloading warnings
---------------------------------------------------------------------------
NotImplementedError                       Traceback (most recent call last)
<ipython-input-3-9009d350791b> in <module>()
----> 1 reload(json)

/usr/local/lib/python3.6/site-packages/IPython/lib/deepreload.py in reload(module, exclude)
    343     try:
    344         with replace_import_hook(deep_import_hook):
--> 345             return deep_reload_hook(module)
    346     finally:
    347         found_now = {}

/usr/local/lib/python3.6/site-packages/IPython/lib/deepreload.py in deep_reload_hook(m)
    315 
    316     try:
--> 317         newm = imp.load_module(name, fp, filename, stuff)
    318     except:
    319          # load_module probably removed name from modules because of

/usr/local/lib/python3.6/imp.py in load_module(name, file, filename, details)
    242             return load_dynamic(name, filename, file)
    243     elif type_ == PKG_DIRECTORY:
--> 244         return load_package(name, filename)
    245     elif type_ == C_BUILTIN:
    246         return init_builtin(name)

/usr/local/lib/python3.6/imp.py in load_package(name, path)
    212                                         submodule_search_locations=[])
    213     if name in sys.modules:
--> 214         return _exec(spec, sys.modules[name])
    215     else:
    216         return _load(spec)

/usr/local/lib/python3.6/importlib/_bootstrap.py in _exec(spec, module)

/usr/local/lib/python3.6/importlib/_bootstrap_external.py in exec_module(self, module)

/usr/local/lib/python3.6/importlib/_bootstrap.py in _call_with_frames_removed(f, *args, **kwds)

/usr/local/lib/python3.6/json/__init__.py in <module>()
    104 __author__ = 'Bob Ippolito <[email protected]>'
    105 
--> 106 from .decoder import JSONDecoder, JSONDecodeError
    107 from .encoder import JSONEncoder
    108 import codecs

/usr/local/lib/python3.6/site-packages/IPython/lib/deepreload.py in deep_import_hook(name, globals, locals, fromlist, level)
    250     parent, buf = get_parent(globals, level)
    251 
--> 252     head, name, buf = load_next(parent, None if level < 0 else parent, name, buf)
    253 
    254     tail = head

/usr/local/lib/python3.6/site-packages/IPython/lib/deepreload.py in load_next(mod, altmod, name, buf)
    153     buf += subname
    154 
--> 155     result = import_submodule(mod, subname, buf)
    156     if result is None and mod != altmod:
    157         result = import_submodule(altmod, subname, subname)

/usr/local/lib/python3.6/site-packages/IPython/lib/deepreload.py in import_submodule(mod, subname, fullname)
    199 
    200         try:
--> 201             m = imp.load_module(fullname, fp, filename, stuff)
    202         except:
    203             # load_module probably removed name from modules because of

/usr/local/lib/python3.6/imp.py in load_module(name, file, filename, details)
    232         raise ValueError(msg)
    233     elif type_ == PY_SOURCE:
--> 234         return load_source(name, filename, file)
    235     elif type_ == PY_COMPILED:
    236         return load_compiled(name, filename, file)

/usr/local/lib/python3.6/imp.py in load_source(name, pathname, file)
    168     spec = util.spec_from_file_location(name, pathname, loader=loader)
    169     if name in sys.modules:
--> 170         module = _exec(spec, sys.modules[name])
    171     else:
    172         module = _load(spec)

/usr/local/lib/python3.6/importlib/_bootstrap.py in _exec(spec, module)

/usr/local/lib/python3.6/importlib/_bootstrap_external.py in exec_module(self, module)

/usr/local/lib/python3.6/importlib/_bootstrap.py in _call_with_frames_removed(f, *args, **kwds)

/usr/local/lib/python3.6/json/decoder.py in <module>()
      1 """Implementation of JSONDecoder
      2 """
----> 3 import re
      4 
      5 from json import scanner

/usr/local/lib/python3.6/site-packages/IPython/lib/deepreload.py in deep_import_hook(name, globals, locals, fromlist, level)
    250     parent, buf = get_parent(globals, level)
    251 
--> 252     head, name, buf = load_next(parent, None if level < 0 else parent, name, buf)
    253 
    254     tail = head

/usr/local/lib/python3.6/site-packages/IPython/lib/deepreload.py in load_next(mod, altmod, name, buf)
    153     buf += subname
    154 
--> 155     result = import_submodule(mod, subname, buf)
    156     if result is None and mod != altmod:
    157         result = import_submodule(altmod, subname, subname)

/usr/local/lib/python3.6/site-packages/IPython/lib/deepreload.py in import_submodule(mod, subname, fullname)
    199 
    200         try:
--> 201             m = imp.load_module(fullname, fp, filename, stuff)
    202         except:
    203             # load_module probably removed name from modules because of

/usr/local/lib/python3.6/imp.py in load_module(name, file, filename, details)
    232         raise ValueError(msg)
    233     elif type_ == PY_SOURCE:
--> 234         return load_source(name, filename, file)
    235     elif type_ == PY_COMPILED:
    236         return load_compiled(name, filename, file)

/usr/local/lib/python3.6/imp.py in load_source(name, pathname, file)
    168     spec = util.spec_from_file_location(name, pathname, loader=loader)
    169     if name in sys.modules:
--> 170         module = _exec(spec, sys.modules[name])
    171     else:
    172         module = _load(spec)

/usr/local/lib/python3.6/importlib/_bootstrap.py in _exec(spec, module)

/usr/local/lib/python3.6/importlib/_bootstrap_external.py in exec_module(self, module)

/usr/local/lib/python3.6/importlib/_bootstrap.py in _call_with_frames_removed(f, *args, **kwds)

/usr/local/lib/python3.6/re.py in <module>()
    120 """
    121 
--> 122 import enum
    123 import sre_compile
    124 import sre_parse

/usr/local/lib/python3.6/site-packages/IPython/lib/deepreload.py in deep_import_hook(name, globals, locals, fromlist, level)
    250     parent, buf = get_parent(globals, level)
    251 
--> 252     head, name, buf = load_next(parent, None if level < 0 else parent, name, buf)
    253 
    254     tail = head

/usr/local/lib/python3.6/site-packages/IPython/lib/deepreload.py in load_next(mod, altmod, name, buf)
    153     buf += subname
    154 
--> 155     result = import_submodule(mod, subname, buf)
    156     if result is None and mod != altmod:
    157         result = import_submodule(altmod, subname, subname)

/usr/local/lib/python3.6/site-packages/IPython/lib/deepreload.py in import_submodule(mod, subname, fullname)
    199 
    200         try:
--> 201             m = imp.load_module(fullname, fp, filename, stuff)
    202         except:
    203             # load_module probably removed name from modules because of

/usr/local/lib/python3.6/imp.py in load_module(name, file, filename, details)
    232         raise ValueError(msg)
    233     elif type_ == PY_SOURCE:
--> 234         return load_source(name, filename, file)
    235     elif type_ == PY_COMPILED:
    236         return load_compiled(name, filename, file)

/usr/local/lib/python3.6/imp.py in load_source(name, pathname, file)
    168     spec = util.spec_from_file_location(name, pathname, loader=loader)
    169     if name in sys.modules:
--> 170         module = _exec(spec, sys.modules[name])
    171     else:
    172         module = _load(spec)

/usr/local/lib/python3.6/importlib/_bootstrap.py in _exec(spec, module)

/usr/local/lib/python3.6/importlib/_bootstrap_external.py in exec_module(self, module)

/usr/local/lib/python3.6/importlib/_bootstrap.py in _call_with_frames_removed(f, *args, **kwds)

/usr/local/lib/python3.6/enum.py in <module>()
      1 import sys
----> 2 from types import MappingProxyType, DynamicClassAttribute
      3 from functools import reduce
      4 from operator import or_ as _or_
      5 

/usr/local/lib/python3.6/site-packages/IPython/lib/deepreload.py in deep_import_hook(name, globals, locals, fromlist, level)
    250     parent, buf = get_parent(globals, level)
    251 
--> 252     head, name, buf = load_next(parent, None if level < 0 else parent, name, buf)
    253 
    254     tail = head

/usr/local/lib/python3.6/site-packages/IPython/lib/deepreload.py in load_next(mod, altmod, name, buf)
    153     buf += subname
    154 
--> 155     result = import_submodule(mod, subname, buf)
    156     if result is None and mod != altmod:
    157         result = import_submodule(altmod, subname, subname)

/usr/local/lib/python3.6/site-packages/IPython/lib/deepreload.py in import_submodule(mod, subname, fullname)
    199 
    200         try:
--> 201             m = imp.load_module(fullname, fp, filename, stuff)
    202         except:
    203             # load_module probably removed name from modules because of

/usr/local/lib/python3.6/imp.py in load_module(name, file, filename, details)
    232         raise ValueError(msg)
    233     elif type_ == PY_SOURCE:
--> 234         return load_source(name, filename, file)
    235     elif type_ == PY_COMPILED:
    236         return load_compiled(name, filename, file)

/usr/local/lib/python3.6/imp.py in load_source(name, pathname, file)
    168     spec = util.spec_from_file_location(name, pathname, loader=loader)
    169     if name in sys.modules:
--> 170         module = _exec(spec, sys.modules[name])
    171     else:
    172         module = _load(spec)

/usr/local/lib/python3.6/importlib/_bootstrap.py in _exec(spec, module)

/usr/local/lib/python3.6/importlib/_bootstrap_external.py in exec_module(self, module)

/usr/local/lib/python3.6/importlib/_bootstrap.py in _call_with_frames_removed(f, *args, **kwds)

/usr/local/lib/python3.6/types.py in <module>()
    169 
    170 
--> 171 import functools as _functools
    172 import collections.abc as _collections_abc
    173 

/usr/local/lib/python3.6/site-packages/IPython/lib/deepreload.py in deep_import_hook(name, globals, locals, fromlist, level)
    250     parent, buf = get_parent(globals, level)
    251 
--> 252     head, name, buf = load_next(parent, None if level < 0 else parent, name, buf)
    253 
    254     tail = head

/usr/local/lib/python3.6/site-packages/IPython/lib/deepreload.py in load_next(mod, altmod, name, buf)
    153     buf += subname
    154 
--> 155     result = import_submodule(mod, subname, buf)
    156     if result is None and mod != altmod:
    157         result = import_submodule(altmod, subname, subname)

/usr/local/lib/python3.6/site-packages/IPython/lib/deepreload.py in import_submodule(mod, subname, fullname)
    199 
    200         try:
--> 201             m = imp.load_module(fullname, fp, filename, stuff)
    202         except:
    203             # load_module probably removed name from modules because of

/usr/local/lib/python3.6/imp.py in load_module(name, file, filename, details)
    232         raise ValueError(msg)
    233     elif type_ == PY_SOURCE:
--> 234         return load_source(name, filename, file)
    235     elif type_ == PY_COMPILED:
    236         return load_compiled(name, filename, file)

/usr/local/lib/python3.6/imp.py in load_source(name, pathname, file)
    168     spec = util.spec_from_file_location(name, pathname, loader=loader)
    169     if name in sys.modules:
--> 170         module = _exec(spec, sys.modules[name])
    171     else:
    172         module = _load(spec)

/usr/local/lib/python3.6/importlib/_bootstrap.py in _exec(spec, module)

/usr/local/lib/python3.6/importlib/_bootstrap_external.py in exec_module(self, module)

/usr/local/lib/python3.6/importlib/_bootstrap.py in _call_with_frames_removed(f, *args, **kwds)

/usr/local/lib/python3.6/functools.py in <module>()
     19     pass
     20 from abc import get_cache_token
---> 21 from collections import namedtuple
     22 from types import MappingProxyType
     23 from weakref import WeakKeyDictionary

/usr/local/lib/python3.6/site-packages/IPython/lib/deepreload.py in deep_import_hook(name, globals, locals, fromlist, level)
    250     parent, buf = get_parent(globals, level)
    251 
--> 252     head, name, buf = load_next(parent, None if level < 0 else parent, name, buf)
    253 
    254     tail = head

/usr/local/lib/python3.6/site-packages/IPython/lib/deepreload.py in load_next(mod, altmod, name, buf)
    153     buf += subname
    154 
--> 155     result = import_submodule(mod, subname, buf)
    156     if result is None and mod != altmod:
    157         result = import_submodule(altmod, subname, subname)

/usr/local/lib/python3.6/site-packages/IPython/lib/deepreload.py in import_submodule(mod, subname, fullname)
    199 
    200         try:
--> 201             m = imp.load_module(fullname, fp, filename, stuff)
    202         except:
    203             # load_module probably removed name from modules because of

/usr/local/lib/python3.6/imp.py in load_module(name, file, filename, details)
    242             return load_dynamic(name, filename, file)
    243     elif type_ == PKG_DIRECTORY:
--> 244         return load_package(name, filename)
    245     elif type_ == C_BUILTIN:
    246         return init_builtin(name)

/usr/local/lib/python3.6/imp.py in load_package(name, path)
    212                                         submodule_search_locations=[])
    213     if name in sys.modules:
--> 214         return _exec(spec, sys.modules[name])
    215     else:
    216         return _load(spec)

/usr/local/lib/python3.6/importlib/_bootstrap.py in _exec(spec, module)

/usr/local/lib/python3.6/importlib/_bootstrap_external.py in exec_module(self, module)

/usr/local/lib/python3.6/importlib/_bootstrap.py in _call_with_frames_removed(f, *args, **kwds)

/usr/local/lib/python3.6/collections/__init__.py in <module>()
     27 from keyword import iskeyword as _iskeyword
     28 import sys as _sys
---> 29 import heapq as _heapq
     30 from _weakref import proxy as _proxy
     31 from itertools import repeat as _repeat, chain as _chain, starmap as _starmap

/usr/local/lib/python3.6/site-packages/IPython/lib/deepreload.py in deep_import_hook(name, globals, locals, fromlist, level)
    250     parent, buf = get_parent(globals, level)
    251 
--> 252     head, name, buf = load_next(parent, None if level < 0 else parent, name, buf)
    253 
    254     tail = head

/usr/local/lib/python3.6/site-packages/IPython/lib/deepreload.py in load_next(mod, altmod, name, buf)
    153     buf += subname
    154 
--> 155     result = import_submodule(mod, subname, buf)
    156     if result is None and mod != altmod:
    157         result = import_submodule(altmod, subname, subname)

/usr/local/lib/python3.6/site-packages/IPython/lib/deepreload.py in import_submodule(mod, subname, fullname)
    199 
    200         try:
--> 201             m = imp.load_module(fullname, fp, filename, stuff)
    202         except:
    203             # load_module probably removed name from modules because of

/usr/local/lib/python3.6/imp.py in load_module(name, file, filename, details)
    232         raise ValueError(msg)
    233     elif type_ == PY_SOURCE:
--> 234         return load_source(name, filename, file)
    235     elif type_ == PY_COMPILED:
    236         return load_compiled(name, filename, file)

/usr/local/lib/python3.6/imp.py in load_source(name, pathname, file)
    168     spec = util.spec_from_file_location(name, pathname, loader=loader)
    169     if name in sys.modules:
--> 170         module = _exec(spec, sys.modules[name])
    171     else:
    172         module = _load(spec)

/usr/local/lib/python3.6/importlib/_bootstrap.py in _exec(spec, module)

/usr/local/lib/python3.6/importlib/_bootstrap_external.py in exec_module(self, module)

/usr/local/lib/python3.6/importlib/_bootstrap.py in _call_with_frames_removed(f, *args, **kwds)

/usr/local/lib/python3.6/heapq.py in <module>()
    585 # If available, use C implementation
    586 try:
--> 587     from _heapq import *
    588 except ImportError:
    589     pass

/usr/local/lib/python3.6/site-packages/IPython/lib/deepreload.py in deep_import_hook(name, globals, locals, fromlist, level)
    250     parent, buf = get_parent(globals, level)
    251 
--> 252     head, name, buf = load_next(parent, None if level < 0 else parent, name, buf)
    253 
    254     tail = head

/usr/local/lib/python3.6/site-packages/IPython/lib/deepreload.py in load_next(mod, altmod, name, buf)
    153     buf += subname
    154 
--> 155     result = import_submodule(mod, subname, buf)
    156     if result is None and mod != altmod:
    157         result = import_submodule(altmod, subname, subname)

/usr/local/lib/python3.6/site-packages/IPython/lib/deepreload.py in import_submodule(mod, subname, fullname)
    199 
    200         try:
--> 201             m = imp.load_module(fullname, fp, filename, stuff)
    202         except:
    203             # load_module probably removed name from modules because of

/usr/local/lib/python3.6/imp.py in load_module(name, file, filename, details)
    240                 return load_dynamic(name, filename, opened_file)
    241         else:
--> 242             return load_dynamic(name, filename, file)
    243     elif type_ == PKG_DIRECTORY:
    244         return load_package(name, filename)

/usr/local/lib/python3.6/imp.py in load_dynamic(name, path, file)
    333         Load an extension module.
    334         """
--> 335         import importlib.machinery
    336         loader = importlib.machinery.ExtensionFileLoader(name, path)
    337 

/usr/local/lib/python3.6/site-packages/IPython/lib/deepreload.py in deep_import_hook(name, globals, locals, fromlist, level)
    250     parent, buf = get_parent(globals, level)
    251 
--> 252     head, name, buf = load_next(parent, None if level < 0 else parent, name, buf)
    253 
    254     tail = head

/usr/local/lib/python3.6/site-packages/IPython/lib/deepreload.py in load_next(mod, altmod, name, buf)
    153     buf += subname
    154 
--> 155     result = import_submodule(mod, subname, buf)
    156     if result is None and mod != altmod:
    157         result = import_submodule(altmod, subname, subname)

/usr/local/lib/python3.6/site-packages/IPython/lib/deepreload.py in import_submodule(mod, subname, fullname)
    199 
    200         try:
--> 201             m = imp.load_module(fullname, fp, filename, stuff)
    202         except:
    203             # load_module probably removed name from modules because of

/usr/local/lib/python3.6/imp.py in load_module(name, file, filename, details)
    242             return load_dynamic(name, filename, file)
    243     elif type_ == PKG_DIRECTORY:
--> 244         return load_package(name, filename)
    245     elif type_ == C_BUILTIN:
    246         return init_builtin(name)

/usr/local/lib/python3.6/imp.py in load_package(name, path)
    212                                         submodule_search_locations=[])
    213     if name in sys.modules:
--> 214         return _exec(spec, sys.modules[name])
    215     else:
    216         return _load(spec)

/usr/local/lib/python3.6/importlib/_bootstrap.py in _exec(spec, module)

/usr/local/lib/python3.6/importlib/_bootstrap_external.py in exec_module(self, module)

/usr/local/lib/python3.6/importlib/_bootstrap.py in _call_with_frames_removed(f, *args, **kwds)

/usr/local/lib/python3.6/importlib/__init__.py in <module>()
     56 
     57 import types
---> 58 import warnings
     59 
     60 

/usr/local/lib/python3.6/site-packages/IPython/lib/deepreload.py in deep_import_hook(name, globals, locals, fromlist, level)
    250     parent, buf = get_parent(globals, level)
    251 
--> 252     head, name, buf = load_next(parent, None if level < 0 else parent, name, buf)
    253 
    254     tail = head

/usr/local/lib/python3.6/site-packages/IPython/lib/deepreload.py in load_next(mod, altmod, name, buf)
    153     buf += subname
    154 
--> 155     result = import_submodule(mod, subname, buf)
    156     if result is None and mod != altmod:
    157         result = import_submodule(altmod, subname, subname)

/usr/local/lib/python3.6/site-packages/IPython/lib/deepreload.py in import_submodule(mod, subname, fullname)
    199 
    200         try:
--> 201             m = imp.load_module(fullname, fp, filename, stuff)
    202         except:
    203             # load_module probably removed name from modules because of

/usr/local/lib/python3.6/imp.py in load_module(name, file, filename, details)
    232         raise ValueError(msg)
    233     elif type_ == PY_SOURCE:
--> 234         return load_source(name, filename, file)
    235     elif type_ == PY_COMPILED:
    236         return load_compiled(name, filename, file)

/usr/local/lib/python3.6/imp.py in load_source(name, pathname, file)
    168     spec = util.spec_from_file_location(name, pathname, loader=loader)
    169     if name in sys.modules:
--> 170         module = _exec(spec, sys.modules[name])
    171     else:
    172         module = _load(spec)

/usr/local/lib/python3.6/importlib/_bootstrap.py in _exec(spec, module)

/usr/local/lib/python3.6/importlib/_bootstrap.py in _init_module_attrs(spec, module, override)

/usr/local/lib/python3.6/importlib/_bootstrap.py in cached(self)

NotImplementedError: 

我认为我们必须变得更聪明，并自动排除无法深度重新加载的模块，并警告用户尚未深度重新加载。

临时解决方案：在递归中添加深度控制。 在Linux上的启动文件夹中使用以下代码：〜/ .ipython / profile_default / startup /
从类型导入ModuleType
从autoreload导入为r重新加载

def reload（module，level = 0）：
“”“递归地重新加载模块。”“”
r（模块）
如果级别> 0：
对于dir（module）中的attribute_name：
属性= getattr（模块，attribute_name）
如果type（attribute）是ModuleType：
重新加载（属性，级别1）

我在尝试使用deepreload.reload也遇到了这个问题

此处相同（重新加载types NotImplementedError types ）

Python 3.6.4
IPython 6.4.0
macOS 10.13.2

我无法使用types复制它，但是我可以通过重新加载deepreload本身来复制它。
Ubuntu 18.04.1 LTS
CPython 3.6.5
IPython 6.5.0