to my understanding, dropout is applied to full-connected layer,
how can i use dropout layer in caffe? is there any demo about this?
shall i use it on top of a ip layer?or anything else?
lixin7895123
All 3 comments
You can simple read the definition files included in examples/imagenet. There are two dropout layers in them.
netheril96
on 9 Sep 2014
Right. Examples are your friends. Please ask on caffe-users. Issues are for development discussion. Thanks!
shelhamer
on 15 Sep 2014
The dropout layer reduces overfitting preventing complex co-adaptations on the training data. Here I provided an example that takes the output of an InnerProduct layer (ip11), after an ReLU layer as an activation function.
layer {
name: "drop1"
type: "Dropout"
bottom: "ip11"
top: "ip11"
dropout_param {
dropout_ratio: 0.5
}
}
In this layer each hidden unit is randomly omitted from the network with a probability of 0.5 (the dropout ratio)
yolanda93
on 4 Jun 2016
Related issues
prathmeshrmadhu
·
3Comments
greatgao
·
3Comments
malreddysid
·
3Comments
iamhankai
·
3Comments
FreakTheMighty
·
3Comments
Most helpful comment
The dropout layer reduces overfitting preventing complex co-adaptations on the training data. Here I provided an example that takes the output of an InnerProduct layer (ip11), after an ReLU layer as an activation function.
layer {
name: "drop1"
type: "Dropout"
bottom: "ip11"
top: "ip11"
dropout_param {
dropout_ratio: 0.5
}
}
In this layer each hidden unit is randomly omitted from the network with a probability of 0.5 (the dropout ratio)