Recent comments in /f/deeplearning
MIKOLAJslippers t1_izy9s51 wrote
Reply to comment by Melodic-Oil-1971 in does anyone know how to build neural network from scratch? by [deleted]
So you will need to implement that maths in your chosen language (easiest would be python and numpy as the syntax is almost the same as I shared). That’s the forward pass from inputs to outputs. You will also need to initialise the weight matrices w1 and w2 to something. Do you have any pretrained weights you can test it with? You may also need to add biases after the matmuls depending on the brief. Usually the case but not necessarily essential to make it train.
Presumably you will also need to then train your network so it’ll get a bit more tricky. You’ll need to implement a loss function based on error between the outputs and some target variable. Once you have the loss you can then use chain rule back through the network to get the delta w (weight gradients) for each weight (w1 and w2 and also any biases if you add those). You’ll then update your weights using some update rule which is usually just multiplying the weight gradients by the learning rate (usually denoted alpha).
Is any of this helpful? Which bit do you still not understand?
Sixo60 OP t1_izy7lbc wrote
Reply to comment by chengstark in Priority of data in deep learning? by Sixo60
Recent issues?
chengstark t1_izy6m4n wrote
Reply to Priority of data in deep learning? by Sixo60
Very.
isuckwithusernames t1_izy6dhd wrote
Reply to comment by Melodic-Oil-1971 in does anyone know how to build neural network from scratch? by [deleted]
I don't believe you spent more than 15 minutes searching for an answer, but here you go: https://towardsdatascience.com/how-to-build-your-own-neural-network-from-scratch-in-python-68998a08e4f6
LW_Master t1_izy5gy1 wrote
The only method I know is matrix multiplication but that was just the forward part. The backward part need an understanding of partial derivation. The code will adapt according to the language...
Melodic-Oil-1971 t1_izy519e wrote
Reply to comment by MIKOLAJslippers in does anyone know how to build neural network from scratch? by [deleted]
Yeah I got those I know all the basic I did all the process on the data I just can't start building the neural
MIKOLAJslippers t1_izy3vs3 wrote
Reply to comment by Melodic-Oil-1971 in does anyone know how to build neural network from scratch? by [deleted]
I don’t think anyone really wants to do your homework for you. Because is seems unlikely you weren’t told how to do this is some form
What’s your starting point here? Are you using python? Do you get numpy?
The maths you want is something like:
acts = act(in X w1)
To get hidden activation where act is your activation function, X is a matrix multiply and w1 has dims of len(in) by hidden size.
Then you do:
out = act(acts X w2)
Where w2 has dims len(acts) by output dims
Melodic-Oil-1971 t1_izy3vmu wrote
Reply to comment by isuckwithusernames in does anyone know how to build neural network from scratch? by [deleted]
I really did , I spent like a week on it but I still didn't know how to code the neural without sklearn or any libraries I posted cuz I lost hope that's all
Duodanglium t1_izy3qpm wrote
Reply to comment by Melodic-Oil-1971 in does anyone know how to build neural network from scratch? by [deleted]
I'm sorry, but with or without an answer will just leave you in the same place.
Sixo60 OP t1_izy33tr wrote
Reply to comment by deepneuralnetwork in Priority of data in deep learning? by Sixo60
& what's the company/team culture around data shortage? "Work with what you've got" or?
isuckwithusernames t1_izy2zwq wrote
That information has unfortunately been lost in time.
Put your exact question into google. The first... 50 links explain how to do it.
Melodic-Oil-1971 t1_izy1pyb wrote
Reply to comment by LiquidDinosaurs69 in does anyone know how to build neural network from scratch? by [deleted]
Okay But how to code the neural itself Like inputs , hidden , outputs
Melodic-Oil-1971 t1_izy07g1 wrote
Reply to comment by Duodanglium in does anyone know how to build neural network from scratch? by [deleted]
Yes, it's not only me that have problems, I asked in department's group to seek any help but no one knows anything It's something so dump tbh
LiquidDinosaurs69 t1_izxzzhr wrote
Yeah. The way to do it is you need to use math
Duodanglium t1_izxzr40 wrote
Reply to comment by Melodic-Oil-1971 in does anyone know how to build neural network from scratch? by [deleted]
You have an assignment to make one but you haven't been taught how?
abhijit1247 OP t1_izxymfk wrote
Reply to Why popular face detection models are failing against cartoons and is there any way to prevent these false positives? by abhijit1247
Hi all I came across a new failure case, I have added it in the original post. There is a chance that the watermark is causing the issue but still, with 71.7% confidence the model has detected it as a face.
Melodic-Oil-1971 t1_izxygph wrote
Reply to comment by BrotherAmazing in does anyone know how to build neural network from scratch? by [deleted]
How?
Melodic-Oil-1971 t1_izxye8s wrote
Reply to comment by Duodanglium in does anyone know how to build neural network from scratch? by [deleted]
I have an assignment but I can't do it from scratch I tried but couldn't so you know how to do it or anything? Or pass anything that I can take the code from it?
Duodanglium t1_izxwke2 wrote
Yes.
BrotherAmazing t1_izxvh0s wrote
Yes
dragnil_ t1_izxnlbo wrote
Reply to Getting started with Deep Learning by MightyDuck35
CS231n(2016) : https://youtube.com/playlist?list=PLkt2uSq6rBVctENoVBg1TpCC7OQi31AlC
Updated and Expanded version of above: Michigan Deep learning for computer vision(2019): https://youtube.com/playlist?list=PL5-TkQAfAZFbzxjBHtzdVCWE0Zbhomg7r
You can find the respective course website using google search. From there you can find the assignments and suggested readings for both of the above courses.
Well, I am not an expert on the subject, but per my experience you have to learn things when you need them. If you think you have to fulfill all the prerequisites before diving into deep learning, you will be stacking different kinds of courses above the two mentioned above. There will be a long list of courses before you are actually starting deep learning. So, just start, go through the readings, assignments and when stuck ask questions, search on Google, see parts of some other courses that are actually relevant.
deepneuralnetwork t1_izxiq1k wrote
Reply to Priority of data in deep learning? by Sixo60
I feel sad when my model lacks data. That’s how I feel.
crimson1206 t1_izxfkya wrote
Reply to comment by MightyDuck35 in Getting started with Deep Learning by MightyDuck35
To correct the other comment all the examples they mentioned are from linear algebra, though calculus is important too.
To understand the deep learning you’ll need linear algebra and multidimensional calculus. For some parts of deep learning you’ll also need probability & statistics knowledge.
boosandy t1_izx7j90 wrote
Reply to Getting started with Deep Learning by MightyDuck35
Andrew Ng's course is the best out there beginners. He dilutes the complexities and slowly teaches all the math. You don't even need any book. That being said, his cpurse is based on Tensorflow. I would suggest learning pytorch on the side.
Melodic-Oil-1971 t1_izya5wt wrote
Reply to comment by MIKOLAJslippers in does anyone know how to build neural network from scratch? by [deleted]
Thank you that was helpful