Recent comments in /f/deeplearning
Prestigious_Boat_386 t1_ivuhxf7 wrote
Reply to comment by suflaj in would it be possible to train something that processes a video and outputs a text script like the following? Teacher: That is the topic we will be covering today. Student 1: What about the part of the lesson we didnt go over yesterday. by [deleted]
Think they want thecombination of that and splitting up when different people talk and assigning what's said to the person saying it.
Which isn't THAT hard when you already can recognice whos who, sometimes you could even just use main pitch & formants and silent segments. It's just quite a niche application.
suflaj t1_ivuam4k wrote
Reply to would it be possible to train something that processes a video and outputs a text script like the following? Teacher: That is the topic we will be covering today. Student 1: What about the part of the lesson we didnt go over yesterday. by [deleted]
You mean automatic speech recognition? Yeah, there are models for that, Google probably has the best proprietary one but from what I understand it is still a work in progress, despite ex. Whisper releasing recently.
cheeky_bastard__ t1_ivu4w2e wrote
Reply to comment by Specialist_Sample_23 in Matlab deep learning skills as good as python? by Specialist_Sample_23
Don't be intimidated by python, it's quite easy to teach yourself, so I would see this as an opportunity to learn Python actually
glenn-jocher t1_ivt8cti wrote
PyTorch is free and much better than Matlab.
TheRealCpnObvious t1_ivsrze9 wrote
Reply to comment by Specialist_Sample_23 in Matlab deep learning skills as good as python? by Specialist_Sample_23
Well now you have the benefit of being able to bring in your trained models from TensorFlow/PyTorch straight into MATLAB.
ImportantBread6462 t1_ivsijps wrote
Reply to BlogNLP: AI Writing Tool by britdev
It's nice of you to create this!
VU22 t1_ivsgucb wrote
I have literally never seen any company use matlab for deep learning. Some of the companies use it for prototyping image processing algorithms or so but pytorch, tensorflow, and keras is by far the gold standard in this area. Additionally I would recommend you to check TensorRT and CUDA if you have C++ experience.
chengstark t1_ivruyad wrote
MATLAB is absolutely garbage for any production use. Maybe good for prototyping, but I have zero idea why you would use that over PyTorch.
justanator101 t1_ivrko53 wrote
I used both Matlab and Python (tensorflow) during my masters research involving image processing. Matlab was great for doing some signal analysis, preprocessing tasks, and even in some cases whipping up simple baseline ML models. I’d export that data and use tensorflow for any deep learning tasks. Like others have said, python is definitely way more used in industry so it’s way better to know tensorflow/PyTorch. The average job will require python and not Matlab. The oddly specific job probably requires both.
werres123 t1_ivrijwo wrote
python is the defacto market standard for deep learning and machine learning. as the final objective is to deploy these models and MATLAB is not suitable for that, gaining skills in python is much more important than MATLAB from ML perspective.
Specialist_Sample_23 OP t1_ivrhht8 wrote
Reply to comment by TheRealCpnObvious in Matlab deep learning skills as good as python? by Specialist_Sample_23
Thanks. Pretty much on the same boat now. Want to pick Matlab coz it’s easier as well as my advisor is comfortable with it. Python curve will Be steep but beneficial. Might end up learning through both. Btw I’m a mechanical engineer so conceptually machine learning itself is new to me.
notgettingfined t1_ivrgtmi wrote
Tensor Flow and PyTorch are not only superior but free. If you go to a company and need to use Matlab it is like $20k for your licenses
TheRealCpnObvious t1_ivr7c26 wrote
MATLAB's deep learning capabilities have been overshadowed by TensorFlow and PyTorch. I'm a MATLAB fanatic and though it pains me to say it, MATLAB has been historically too restrictive for DL practitioners looking to really innovate in the field. However, MATLAB is very good for rapid prototyping for a variety of applications (DL included; the Deep Learning tools and apps really do make it a lot easier to prototype with different experimental setups etc) but they still lag the popular frameworks in terms of SOTA implementations etc. MATLAB is also good to get you started with DL if you're a non-programmer and already know it, so it's got a lower relative barrier to entry and initial learning curve. So if you're an engineer looking to apply some deep learning models from the last few years then MATLAB can be enough (and even with some Cross-Framework interoperability in some limited cases), but if you're trying to solve fairly new problems then you might struggle.
These are my two cents having done the bulk of my DL research in MATLAB for my PhD, which I completed last year. Started off with the intention of learning Python and TensorFlow for my DL research but ultimately chose MATLAB for short-sighted convenience reasons that cost me the opportunity to learn the better tools/frameworks over the medium term.
ISlingStocks t1_ivr574c wrote
Reply to comment by OutrageousSundae8270 in Matlab deep learning skills as good as python? by Specialist_Sample_23
Thanks for the thorough response! I'll have to check out lme4.
OutrageousSundae8270 t1_ivr463t wrote
Reply to comment by ISlingStocks in Matlab deep learning skills as good as python? by Specialist_Sample_23
From my perspective, R is great for certain tasks (more related to classical machine learning and statistical analysis as you have mentioned). There are several libraries that have demonstrably better implementations in R than Python (lme4 comes to mind).
I will have to circle back to the same point regarding deep learning and Python. Whilst R does offer deep learning capabilities in its modern iterations, the uptake of using R in such a fashion pales in comparison to the uptake of Python, so the same comment I made about MATLAB still applies.
ISlingStocks t1_ivr38zl wrote
Reply to comment by OutrageousSundae8270 in Matlab deep learning skills as good as python? by Specialist_Sample_23
This was extremely helpful. What are your thoughts on R? Similar to MATLAB? My understanding is R is great with statistical analysis (therefore shouldn't be shocked that is has robust deep learning capabilities) but Python is just so much more utilized because of the community as whole.
OutrageousSundae8270 t1_ivqynjm wrote
TensorFlow/Keras and PyTorch are the gold standard for deep learning frameworks within the industry, and these are both Python frameworks. It's not just about it being open source, its more about it being the tool of the trade. Nobody is going to employ you within a team that uses Python frameworks for deep learning, unless you are skilled at those frameworks.
MATLAB isn't really popular for deep learning, even though it does facilitate some deep learning capabilities (relative to Python).
xyrlor OP t1_ivlicka wrote
Reply to comment by fjodpod in Are AMD GPUs an option? by xyrlor
That's what I'm currently considering too. But I'm not optimistic about mid tier card prices, considering how the 4080 and 4090 are priced.
0ffcode t1_ivkrxg7 wrote
Reply to BlogNLP: AI Writing Tool by britdev
How is it different from other tools based on GPT-3?
0ffcode t1_ivkr703 wrote
Reply to comment by britdev in BlogNLP: AI Writing Tool by britdev
Why are you financing it?
fjodpod t1_ivk6pbg wrote
Reply to comment by xyrlor in Are AMD GPUs an option? by xyrlor
Personally i would either wait for the 4000 series midtier cards or just buy a 3000 series card with enough vRAM. However keep in mind that the 4000 Series theoretically could be worse or on par for machine learning than the 3000 series in some cases due to lower memory throughput: (https://www.reddit.com/r/MachineLearning/comments/xjt129/comment/ipb6p8y/?utm_source=share&utm_medium=web2x&context=3)
Emotional-Fox-4285 OP t1_ivjbz4s wrote
Reply to comment by HowdThatGoIn in In my deep NN with 3 layer, . In the second iteration of GD, The activation of Layer 1 and Layer 2 output all 0 due to ReLU as all the input are smaller than 0. And L3 output some value with high floating point which is opposite to first forward_ propagation . Is this how it should work ? by Emotional-Fox-4285
I send you the link to my notebook...
I am beginner ,therefore very lack of knowledge and couldn't find it out myself.
I will be grateful if you take a look of my notebook and feel free to suggest any change.
https://drive.google.com/file/d/1S5s5d6x0iwFOYk9SimiZt2U_6dLNierP/view?usp=sharing
HowdThatGoIn t1_ivi1zzn wrote
Reply to In my deep NN with 3 layer, . In the second iteration of GD, The activation of Layer 1 and Layer 2 output all 0 due to ReLU as all the input are smaller than 0. And L3 output some value with high floating point which is opposite to first forward_ propagation . Is this how it should work ? by Emotional-Fox-4285
I can’t say for certain without the code but it looks like the loss is being applied to every hidden unit (as a scalar) rather than being distributed based off of each units contribution to the loss (as a vector). Check the shape of your loss as it moves through each layer?
Edit: also, are you applying the total loss or the mean loss? It should be the latter.
elbiot t1_ivexlrx wrote
Reply to comment by Emotional-Fox-4285 in In my deep NN with 3 layer, . In the second iteration of GD, The activation of Layer 1 and Layer 2 output all 0 due to ReLU as all the input are smaller than 0. And L3 output some value with high floating point which is opposite to first forward_ propagation . Is this how it should work ? by Emotional-Fox-4285
No I don't have time for that. Good luck
Snickersman6 t1_ivuitev wrote
Reply to comment by Prestigious_Boat_386 in would it be possible to train something that processes a video and outputs a text script like the following? Teacher: That is the topic we will be covering today. Student 1: What about the part of the lesson we didnt go over yesterday. by [deleted]
Right it's that secondary splitting of the text that I don't know if it's possible.