Recent comments in /f/deeplearning
rePAN6517 t1_iykx7yv wrote
LeCun: 1
Marcus: 0
KhainenX t1_iykussg wrote
Noice!!
suflaj t1_iyktdbc wrote
Reply to comment by Santhosh999 in Doubt regarding activation functions by Santhosh999
Well, you have to change your labels from being 1 long to 2 long. If your labels are True or 1 and False or 0, you will need to change them to [0, 1] and [1, 0]
Santhosh999 OP t1_iykgddd wrote
Reply to comment by suflaj in Doubt regarding activation functions by Santhosh999
I am getting an error when tried with 2 neurons and softmax activation func with binary crossentropy loss.
ValueError: logits and labels must have the same shape ((None, 2) vs (None, 1))
suflaj t1_iykea48 wrote
Reply to comment by Santhosh999 in Doubt regarding activation functions by Santhosh999
Doesn't matter. Softmax is just a multidimensional sigmoid. For binary classifications you can therefore use either 1 output and a sigmoid, or 2 outputs and a softmax. The only difference is that with a sigmoid you resolve the result as
is_fraud = result > 0.5
while with softmax you'd do
is_fraud = argmax(result) == 1
Santhosh999 OP t1_iykdg48 wrote
Reply to comment by suflaj in Doubt regarding activation functions by Santhosh999
what about loss function I need to use?
Santhosh999 OP t1_iykdd5p wrote
Reply to comment by jellyfishwhisperer in Doubt regarding activation functions by Santhosh999
yes, it is imbalanced
jellyfishwhisperer t1_iyjv41y wrote
Reply to Doubt regarding activation functions by Santhosh999
Do the positive classes make up 0.17% of your data? A softmax of a single neuron should be 1 always right?
incrediblediy t1_iyjrk9c wrote
Reply to comment by democracyab in RTX 2060 or RTX 3050 by democracyab
get a used card (may be $200 ?), not brand new. PSU are not that expensive now (may be $50?), I used to have a 450W Silverstone 80+ Bronze with Ryzen5600x + RTX3060, it worked well.
Anyway, you will need a PSU for RTX2060 as well. RTX2060 & RTX3060 has almost same power requirement.
mr_birrd t1_iyjlsb4 wrote
Reply to comment by ApplicationBoth1829 in RTX 2060 or RTX 3050 by democracyab
p40 for less than 150???
C0demunkee t1_iyipj52 wrote
Reply to comment by ApplicationBoth1829 in RTX 2060 or RTX 3050 by democracyab
I've got an M40 and love it
ApplicationBoth1829 t1_iyi2jon wrote
Reply to RTX 2060 or RTX 3050 by democracyab
2060 with 12g vram definitely better.
Tesla p40 is also a good choice,it is slower but 24g vram for less than 150$(modification required).
democracyab OP t1_iyht5yv wrote
Reply to comment by incrediblediy in RTX 2060 or RTX 3050 by democracyab
in my country both of them are near 300$ but 3060 is around 400$. If I want to upgrade to 3060, I have to upgrade my psu that cause me an extra cost!
incrediblediy t1_iyho8ms wrote
Reply to comment by democracyab in RTX 2060 or RTX 3050 by democracyab
how much is 3050 ?
WhizzleTeabags t1_iyhh1ws wrote
Reply to RTX 2060 or RTX 3050 by democracyab
I use A5000 and love it
democracyab OP t1_iyhft8r wrote
Reply to comment by incrediblediy in RTX 2060 or RTX 3050 by democracyab
My budget is limited and I can't buy 3060 :(
incrediblediy t1_iyh9xby wrote
Reply to RTX 2060 or RTX 3050 by democracyab
Used RTX3060 would be better, with 12GB VRAM too. It helped me greatly. what is your budget ? even new 3060 is around US$300 here.
nutpeabutter t1_iyh6f22 wrote
Reply to RTX 2060 or RTX 3050 by democracyab
- 3 times the tensor cores and 1.5x the bandwidth. 6 and 8gb really ain't much.
suflaj t1_iyh2wil wrote
Reply to Doubt regarding activation functions by Santhosh999
Well for softmax you need at least 2 neurons
neinbullshit t1_iyh26a4 wrote
Reply to RTX 2060 or RTX 3050 by democracyab
Higher memory is generally better for deep learning tasks. Specially with the size of models now
Blueberry-Tacos t1_iygvvgh wrote
Reply to Doubt regarding activation functions by Santhosh999
Softmax activation function is usually used for multi categorical classification. Knowing that you are building a binary classification model, sigmoid is better for your application :)
EDIT : I've made a mistake. It is not used for multi categorical classification but to be able to classify multiple 'categories' from one input.
[deleted] t1_iygm689 wrote
Reply to Doubt regarding activation functions by Santhosh999
[removed]
sushil79g t1_iyf81lh wrote
Reply to If the dataset is too big to fit into your RAM, but you still wish to train, how do you do it? by somebodyenjoy
I always use dask for this kind of situation. works perfectlyly
AmazingKitten t1_iyevdxx wrote
Reply to If the dataset is too big to fit into your RAM, but you still wish to train, how do you do it? by somebodyenjoy
Use a custom Dataset class.
Superschlenz t1_iykzfiw wrote
Reply to GPT-3 Generated Rap Battle between Yann LeCun & Gary Marcus by hayAbhay
Any day rhymes with league?
Gary's AI has violated the rhyming law!