#!/usr/bin/env ruby
# Taken from faraday internals
def middleware_mutex(&block)
<strong i="5">@middleware_mutex</strong> ||= begin
require 'monitor'
puts "I'm making a monitor!"
Monitor.new
end
puts @middleware_mutex.inspect
@middleware_mutex.synchronize(&block)
end
threads = 10.times.collect do
Thread.new do
middleware_mutex do
puts "I got the power!"
end
end
end
threads.each(&:join)
这是 2.6 的示例输出:
koyoko% rvm use 2.6
Using /home/samuel/.rvm/gems/ruby-2.6.3
^[[A% koyoko% ./middleware_mutex.rb
I'm making a monitor!
#<Monitor:0x000055fb2217ec60 @mon_mutex=#<Thread::Mutex:0x000055fb2217ec10>, @mon_mutex_owner_object_id=47268548572720, @mon_owner=nil, @mon_count=0>
I got the power!
#<Monitor:0x000055fb2217ec60 @mon_mutex=#<Thread::Mutex:0x000055fb2217ec10>, @mon_mutex_owner_object_id=47268548572720, @mon_owner=nil, @mon_count=0>
I got the power!
#<Monitor:0x000055fb2217ec60 @mon_mutex=#<Thread::Mutex:0x000055fb2217ec10>, @mon_mutex_owner_object_id=47268548572720, @mon_owner=nil, @mon_count=0>
I got the power!
#<Monitor:0x000055fb2217ec60 @mon_mutex=#<Thread::Mutex:0x000055fb2217ec10>, @mon_mutex_owner_object_id=47268548572720, @mon_owner=nil, @mon_count=0>
I got the power!
#<Monitor:0x000055fb2217ec60 @mon_mutex=#<Thread::Mutex:0x000055fb2217ec10>, @mon_mutex_owner_object_id=47268548572720, @mon_owner=nil, @mon_count=0>
I got the power!
#<Monitor:0x000055fb2217ec60 @mon_mutex=#<Thread::Mutex:0x000055fb2217ec10>, @mon_mutex_owner_object_id=47268548572720, @mon_owner=nil, @mon_count=0>
I got the power!
#<Monitor:0x000055fb2217ec60 @mon_mutex=#<Thread::Mutex:0x000055fb2217ec10>, @mon_mutex_owner_object_id=47268548572720, @mon_owner=nil, @mon_count=0>
I got the power!
#<Monitor:0x000055fb2217ec60 @mon_mutex=#<Thread::Mutex:0x000055fb2217ec10>, @mon_mutex_owner_object_id=47268548572720, @mon_owner=nil, @mon_count=0>
I got the power!
#<Monitor:0x000055fb2217ec60 @mon_mutex=#<Thread::Mutex:0x000055fb2217ec10>, @mon_mutex_owner_object_id=47268548572720, @mon_owner=nil, @mon_count=0>
I got the power!
#<Monitor:0x000055fb2217ec60 @mon_mutex=#<Thread::Mutex:0x000055fb2217ec10>, @mon_mutex_owner_object_id=47268548572720, @mon_owner=nil, @mon_count=0>
I got the power!
koyoko% ./middleware_mutex.rb
I'm making a monitor!
I'm making a monitor!
#<Monitor:0x000055f197e82388 @mon_mutex=#<Thread::Mutex:0x000055f197e82338>, @mon_mutex_owner_object_id=47248062026180, @mon_owner=nil, @mon_count=0>
I got the power!
I'm making a monitor!
#<Monitor:0x000055f197e81eb0 @mon_mutex=#<Thread::Mutex:0x000055f197e81e60>, @mon_mutex_owner_object_id=47248062025560, @mon_owner=nil, @mon_count=0>
I got the power!
I'm making a monitor!
#<Monitor:0x000055f197e81b90 @mon_mutex=#<Thread::Mutex:0x000055f197e81b40>, @mon_mutex_owner_object_id=47248062025160, @mon_owner=nil, @mon_count=0>
I got the power!
I'm making a monitor!
#<Monitor:0x000055f197e81938 @mon_mutex=#<Thread::Mutex:0x000055f197e818e8>, @mon_mutex_owner_object_id=47248062024860, @mon_owner=nil, @mon_count=0>
I got the power!
I'm making a monitor!
#<Monitor:0x000055f197e816e0 @mon_mutex=#<Thread::Mutex:0x000055f197e81690>, @mon_mutex_owner_object_id=47248062024560, @mon_owner=nil, @mon_count=0>
I got the power!
#<Monitor:0x000055f197e827c0 @mon_mutex=#<Thread::Mutex:0x000055f197e82590>, @mon_mutex_owner_object_id=47248062026720, @mon_owner=nil, @mon_count=0>
I got the power!
I'm making a monitor!
#<Monitor:0x000055f197e81438 @mon_mutex=#<Thread::Mutex:0x000055f197e813e8>, @mon_mutex_owner_object_id=47248062024220, @mon_owner=nil, @mon_count=0>
I got the power!
I'm making a monitor!
#<Monitor:0x000055f197e811e0 @mon_mutex=#<Thread::Mutex:0x000055f197e81190>, @mon_mutex_owner_object_id=47248062023920, @mon_owner=nil, @mon_count=0>
I got the power!
I'm making a monitor!
#<Monitor:0x000055f197e80f88 @mon_mutex=#<Thread::Mutex:0x000055f197e80f38>, @mon_mutex_owner_object_id=47248062023620, @mon_owner=nil, @mon_count=0>
I got the power!
I'm making a monitor!
#<Monitor:0x000055f197e80d30 @mon_mutex=#<Thread::Mutex:0x000055f197e80ce0>, @mon_mutex_owner_object_id=47248062023320, @mon_owner=nil, @mon_count=0>
I got the power!
这是 jruby 上的示例输出:
koyoko% rvm use jruby
Using /home/samuel/.rvm/gems/jruby-9.2.6.0
koyoko% ./middleware_mutex.rb
I'm making a monitor!
I'm making a monitor!
I'm making a monitor!
#<Monitor:0x7ea668b0 @mon_mutex=#<Thread::Mutex:0x3027cbd3>, @mon_owner=nil, @mon_count=0>
I got the power!
I'm making a monitor!I'm making a monitor!#<Monitor:0x53ca91a5 @mon_mutex=#<Thread::Mutex:0x57f50f04>, @mon_owner=nil, @mon_count=0>I'm making a monitor!
#<Monitor:0x1b5e79ce @mon_mutex=#<Thread::Mutex:0x159994d5>, @mon_owner=nil, @mon_count=0>
I got the power!
#<Monitor:0x67589eb3 @mon_mutex=#<Thread::Mutex:0x63671680>, @mon_owner=nil, @mon_count=1>#<Monitor:0x1b5e79ce @mon_mutex=#<Thread::Mutex:0x159994d5>, @mon_owner=nil, @mon_count=0>
I got the power!
#<Monitor:0x67589eb3 @mon_mutex=#<Thread::Mutex:0x63671680>, @mon_owner=nil, @mon_count=0>
I got the power!
#<Monitor:0x49c2c95a @mon_mutex=#<Thread::Mutex:0xcc04e06>, @mon_owner=nil, @mon_count=0>
I got the power!
I'm making a monitor!#<Monitor:0x1b5e79ce @mon_mutex=#<Thread::Mutex:0x159994d5>, @mon_owner=nil, @mon_count=0>
#<Monitor:0x6fa38df1 @mon_mutex=#<Thread::Mutex:0x756e0d98>, @mon_owner=nil, @mon_count=0>
I got the power!
I got the power!
#<Monitor:0x4a9f0f52 @mon_mutex=#<Thread::Mutex:0x600dfde7>, @mon_owner=nil, @mon_count=0>
I got the power!
I got the power!
I got the power!
如果你在 JRuby 上运行它, <strong i="5">@middleware_mutex</strong> ||= begin
不是原子的,你不仅最终会多次执行该块,而且@middleware_mutex
实际上会多次设置到不同的监视器。 看起来这也可能发生在 2.6 上,因为puts
可以引入阻塞/线程上下文切换。
_谢谢分析!_
看到||=
不保证单一分配,这很有趣,即使在 MRI 上也是如此。
@eregon是的,我也对此感到惊讶。 我们可以转储指令以查看实际情况吗?
@ioquatix
$ xsel -b | ruby --dump=insns
...
== disasm: #<ISeq:middleware_mutex@-:1 (1,0)-(9,3)> (catch: FALSE)
local table (size: 1, argc: 0 [opts: 0, rest: -1, post: 0, block: 0, kw: -1@-1, kwrest: -1])
[ 1] block@0<Block>
0000 putnil ( 2)[LiCa]
0001 defined instance-variable, :<strong i="7">@middleware_mutex</strong>, false
0005 branchunless 14
0007 getinstancevariable :<strong i="8">@middleware_mutex</strong>, <is:0>
0010 dup
0011 branchif 42
0013 pop
0014 putself ( 3)[Li]
0015 putstring "monitor"
0017 opt_send_without_block <callinfo!mid:require, argc:1, FCALL|ARGS_SIMPLE>, <callcache>
0020 pop
0021 putself ( 4)[Li]
0022 putstring "I'm making a monitor!"
0024 opt_send_without_block <callinfo!mid:puts, argc:1, FCALL|ARGS_SIMPLE>, <callcache>
0027 pop
0028 opt_getinlinecache 35, <is:1> ( 5)[Li]
0031 getconstant :Monitor
0033 opt_setinlinecache <is:1>
0035 opt_send_without_block <callinfo!mid:new, argc:0, ARGS_SIMPLE>, <callcache>
0038 dup ( 2)
0039 setinstancevariable :<strong i="9">@middleware_mutex</strong>, <is:0>
0042 pop
0043 putself ( 7)[Li]
0044 getinstancevariable :<strong i="10">@middleware_mutex</strong>, <is:0>
0047 opt_send_without_block <callinfo!mid:inspect, argc:0, ARGS_SIMPLE>, <callcache>
0050 opt_send_without_block <callinfo!mid:puts, argc:1, FCALL|ARGS_SIMPLE>, <callcache>
0053 pop
0054 getinstancevariable :<strong i="11">@middleware_mutex</strong>, <is:0> ( 8)[Li]
0057 getblockparamproxy block<strong i="12">@0</strong>, 0
0060 send <callinfo!mid:synchronize, argc:0, ARGS_BLOCKARG>, <callcache>, nil
0064 leave ( 9)[Re]
所以||=
就像:
if defined?(@middleware_mutex)
<strong i="17">@middleware_mutex</strong>
else
<strong i="18">@middleware_mutex</strong> = expression
end
为了使它在 MRI 中不被覆盖,我们需要:
if defined?(@middleware_mutex)
<strong i="22">@middleware_mutex</strong>
else
result = expression
# special bytecode to do `<strong i="23">@middleware_mutex</strong> = result unless defined?(@middleware_mutex)` atomically
end
当然,这是有代价的,因为它是分配前的额外检查。
并且该块仍将执行多次,尝试自动修复该问题可能会导致死锁和高开销,因此最好将这部分留给用户代码。
哦,我完全同意这不是我们可以自动修复的问题,代码从线程安全的 POV 中被严重破坏,并且使 ||= atomic 不会解决这个问题。
哇,感谢@ioquatix的分析,再次可以清楚地看到您在该主题方面的专业知识。
也就是说,据我所知,我猜这是专门为支持 JRuby 和其他并发 ruby 实现而引入的一段相当古老的代码。
今天,我们不再正式支持 JRuby 和其他非 MRI 红宝石,主要是因为我认为我们缺乏这样做的必要知识,但我们只是保持不变,希望它至少能有所帮助。
我不确定如何解决这个问题,如果您或@eregon可以为我们指明正确的方向,我很乐意获得一些知识并看看🤓
这也是 CRuby 上的一个错误。 我可以提交 PR。
我在#1074 中尝试了一种解决方案。 我有另一个想法,涉及将MiddlewareRegistry
模块转换为类。 所以代替这个:
它可能是这样的:
module Faraday
class Response
self.middleware_registry = MiddlewareRegistry.new(File.expand_path('response', __dir__),
raise_error: [:RaiseError, 'raise_error'],
logger: [:Logger, 'logger'],
)
这不依赖于类生命周期钩子。 很明显,当解释 ruby 时,这里正在实例化MiddlewareRegistry
。
class MiddlewareRegistry
def initialize
<strong i="14">@mutex</strong> = Monitor.new
end
end
最有用的评论
@ioquatix
所以
||=
就像:为了使它在 MRI 中不被覆盖,我们需要:
当然,这是有代价的,因为它是分配前的额外检查。
并且该块仍将执行多次,尝试自动修复该问题可能会导致死锁和高开销,因此最好将这部分留给用户代码。