Recent comments in /f/deeplearning
Specialist_Sample_23 OP t1_iwli5c4 wrote
Reply to comment by cheeky_bastard__ in Matlab deep learning skills as good as python? by Specialist_Sample_23
Sure, thank you:)
pornthrowaway42069l t1_iwlbxq2 wrote
Reply to How to normalize data which contain positive and negative numbers into 0 and 1 by Constant-Cranberry29
You can try neglog,
x > 0: log(x)
x<0: -log(-x)
eternal-abyss-77 OP t1_iwkd5k0 wrote
Reply to comment by arhetorical in Can someone explain me the math behind this paper and tell me whether the way I have understood this paper is right or not? by eternal-abyss-77
I would Like to show you my implementation of this paper, to how it acts on images.
So, I can ask you more on what exactly my issue is
eternal-abyss-77 OP t1_iwkd1u3 wrote
Reply to comment by arhetorical in Can someone explain me the math behind this paper and tell me whether the way I have understood this paper is right or not? by eternal-abyss-77
So how is rotation explained in the paper? Like which equations I should look into?
eternal-abyss-77 OP t1_iwjvpds wrote
Reply to comment by onkus in Can someone explain me the math behind this paper and tell me whether the way I have understood this paper is right or not? by eternal-abyss-77
So I - HL will be
[ 1 0 0 0 0 -1 0 ]
[ 0 1 0 0 0 0 -1 ]
[ 0 0 1 0 0 0 0 ]
[ 0 0 0 1 0 0 0 ]
[ 0 0 0 0 1 0 0 ]
[ -1 0 0 0 0 1 0 ]
[ 0 -1 0 0 0 0 1 ]
This. And same goes for I - VL
Fine.
What do they mean by those rotations?
onkus t1_iwja7ea wrote
Reply to comment by eternal-abyss-77 in Can someone explain me the math behind this paper and tell me whether the way I have understood this paper is right or not? by eternal-abyss-77
What do you mean by “mirror of H"? I is always the identity matrix here. Why do you think it could be the "mirror" of H?
PredictorX1 t1_iwiflod wrote
Assuming that you will not change the network architecture, I suggest concatenating both data sets, start training using the existing weights, and train as long as necessary. I would suggest re-examining the size of the hidden layer, though (which implies starting training over from scratch).
arhetorical t1_iwh7ra9 wrote
Reply to comment by eternal-abyss-77 in Can someone explain me the math behind this paper and tell me whether the way I have understood this paper is right or not? by eternal-abyss-77
I replied below.
arhetorical t1_iwh7pz0 wrote
Reply to comment by eternal-abyss-77 in Can someone explain me the math behind this paper and tell me whether the way I have understood this paper is right or not? by eternal-abyss-77
The identity matrix can be different sizes:
https://en.wikipedia.org/wiki/Identity_matrix
As for the rotations, it's in reference to the top of figure 3 and the position of the blue and red pixel.
eternal-abyss-77 OP t1_iwg7mjm wrote
Reply to comment by onkus in Can someone explain me the math behind this paper and tell me whether the way I have understood this paper is right or not? by eternal-abyss-77
I am asking what is
I - H is?
I get the same H as you say, but what is the matrix we get after I - H? Is it a mirror of H? As in paper, they said
I -I
-I I
So, the I in I-H is, normal identity matrix where major diagonal elements are 1 or is it mirror of H
onkus t1_iwg7e0e wrote
Reply to comment by eternal-abyss-77 in Can someone explain me the math behind this paper and tell me whether the way I have understood this paper is right or not? by eternal-abyss-77
I dont follow what you are showing with those matrices. You should actually ask a question.
Are you stating what H x I is? If so, you are using the same definition in your original question which i just said was wrong. I could have been more specific about H: each row and xolumn will have exactly one occurance of a 1 and N-1 zeros.
H =
0 0 1 0 0 0 0
0 0 0 1 0 0 0
0 0 0 0 1 0 0
0 0 0 0 0 1 0
0 0 0 0 0 0 1
1 0 0 0 0 0 0
0 1 0 0 0 0 0
for l =2,N=7
Do you know how to subtract matrices from one another? The second and third matrix you show suggests you don't.
Im not sure what to elaborate on regarding the rotation that the authors dont mention in their paper. I could talk for hours about rotations, pixel differences, numerical gradients etc. Im not just going to ramble on without context. What do you want to know?
eternal-abyss-77 OP t1_iwg5fm0 wrote
Reply to comment by onkus in Can someone explain me the math behind this paper and tell me whether the way I have understood this paper is right or not? by eternal-abyss-77
> Yes, I is the identity matrix.
> The shift matrix, H, will not have a row or column with only zeros in it. If l is 2 and N is 7 then H(1, 3) (1 based?) will be a 1 and the start of a diagonal.
> You have similarly misunderstood equation 4. There will not be a row or column with only 0s in it.
Hl is this
[ 0 0 0 0 0 1 0 ]
[ 0 0 0 0 0 0 1 ]
[ 0 0 0 0 0 0 0 ]
[ 0 0 0 0 0 0 0 ]
[ 0 0 0 0 0 0 0 ]
[ 1 0 0 0 0 0 0 ]
[ 0 1 0 0 0 0 0 ]
I - Hl is ?
[ 1 0 0 0 0 -1 0 ]
[ 0 1 0 0 0 0 -1 ]
[ 0 0 0 0 0 0 0 ]
[ 0 0 0 0 0 0 0 ]
[ 0 0 0 0 0 0 0 ]
[ -1 0 0 0 0 1 0 ]
[ 0 -1 0 0 0 0 1 ]
Or
[ 1 0 0 0 0 -1 0 ]
[ 0 1 0 0 0 0 -1 ]
[ 0 0 1 0 0 0 0 ]
[ 0 0 0 1 0 0 0 ]
[ 0 0 0 0 1 0 0 ]
[ -1 0 0 0 0 1 0 ]
[ 0 -1 0 0 0 0 1 ]
?
Show me how the matrix is written
And elaborate this:
> The authors do not mention rotation at all in this paper. They do mention that gradients are computed along those directions by the pixel differences.
eternal-abyss-77 OP t1_iwg59kg wrote
onkus t1_iwg3rav wrote
Reply to comment by eternal-abyss-77 in Can someone explain me the math behind this paper and tell me whether the way I have understood this paper is right or not? by eternal-abyss-77
Much better to keep going here. Others can see and learn and/or contribute. Everyone is better off.
Do you have more questions?
eternal-abyss-77 OP t1_iwg0e31 wrote
Reply to comment by onkus in Can someone explain me the math behind this paper and tell me whether the way I have understood this paper is right or not? by eternal-abyss-77
Please see dm
onkus t1_iwfzulx wrote
Reply to comment by eternal-abyss-77 in Can someone explain me the math behind this paper and tell me whether the way I have understood this paper is right or not? by eternal-abyss-77
Yes, I is the identity matrix.
The shift matrix, H, will not have a row or column with only zeros in it. If l is 2 and N is 7 then H(1, 3) (1 based) will be a 1 and the start of a diagonal.
You have similarly misunderstood equation 4. There will not be a row or column with only 0s in it.
The authors do not mention rotation at all in this paper. They do mention that gradients are computed along those directions by the pixel differences.
eternal-abyss-77 OP t1_iwfxk5b wrote
Reply to comment by onkus in Can someone explain me the math behind this paper and tell me whether the way I have understood this paper is right or not? by eternal-abyss-77
Ok I'll ask you exactly what i don't understand.
In equations 2 and 4 there is I which represents Identity matrix right?
So if let's say l = 2 and N = 7
Now will the shift matrix be like
[ 0 0 0 0 0 1 0 ]
[ 0 0 0 0 0 0 1 ]
[ 0 0 0 0 0 0 0 ]
[ 0 0 0 0 0 0 0 ]
[ 0 0 0 0 0 0 0 ]
[ 1 0 0 0 0 0 0 ]
[ 0 1 0 0 0 0 0 ]
If yes, then
[ I -I ]
[-I I ]
Should be of the form,
[ 1 0 0 0 0 -1 0 ]
[ 0 1 0 0 0 0 -1 ]
[ 0 0 0 0 0 0 0 ]
[ 0 0 0 0 0 0 0 ]
[ 0 0 0 0 0 0 0 ]
[ -1 0 0 0 0 1 0 ]
[ 0 -1 0 0 0 0 1 ]
Or
[ 1 0 0 0 0 -1 0 ]
[ 0 1 0 0 0 0 -1 ]
[ 0 0 1 0 0 0 0 ]
[ 0 0 0 1 0 0 0 ]
[ 0 0 0 0 1 0 0 ]
[ -1 0 0 0 0 1 0 ]
[ 0 -1 0 0 0 0 1 ]
?
Be it horizontal shift or vertical shift.
And what do they mean by rotations here : 0°, 45°, 90°, 135° ?
Because I'm extending this idea, so I am asking community help, perspectives, opinions and understandings, so I may not be wrongly understanding math.
eternal-abyss-77 OP t1_iwfx6f4 wrote
Reply to Can someone explain me the math behind this paper and tell me whether the way I have understood this paper is right or not? by eternal-abyss-77
Ok I'll ask you exactly what i don't understand.
In equations 2 and 4 there is I which represents Identity matrix right?
So if let's say l = 2 and N = 7
Now will the shift matrix be like
[ 0 0 0 0 0 1 0 ]
[ 0 0 0 0 0 0 1 ]
[ 0 0 0 0 0 0 0 ]
[ 0 0 0 0 0 0 0 ]
[ 0 0 0 0 0 0 0 ]
[ 1 0 0 0 0 0 0 ]
[ 0 1 0 0 0 0 0 ]
If yes, then
[ I -I ]
[-I I ]
Should be of the form,
[ 1 0 0 0 0 -1 0 ]
[ 0 1 0 0 0 0 -1 ]
[ 0 0 0 0 0 0 0 ]
[ 0 0 0 0 0 0 0 ]
[ 0 0 0 0 0 0 0 ]
[ -1 0 0 0 0 1 0 ]
[ 0 -1 0 0 0 0 1 ]
Or
[ 1 0 0 0 0 -1 0 ]
[ 0 1 0 0 0 0 -1 ]
[ 0 0 1 0 0 0 0 ]
[ 0 0 0 1 0 0 0 ]
[ 0 0 0 0 1 0 0 ]
[ -1 0 0 0 0 1 0 ]
[ 0 -1 0 0 0 0 1 ]
?
Be it horizontal shift or vertical shift.
And what do they mean by rotations here : 0°, 45°, 90°, 135° ?
Because I'm extending this idea, so I am asking community help, perspectives, opinions and understandings, so I may not be wrongly understanding math.
onkus t1_iwfw2jo wrote
Reply to comment by eternal-abyss-77 in Can someone explain me the math behind this paper and tell me whether the way I have understood this paper is right or not? by eternal-abyss-77
How can anyone answer this?
If you are wanting people to tell you if you've understood it correctly, you need to tell us what your understanding is.
eternal-abyss-77 OP t1_iwfu277 wrote
Reply to comment by onkus in Can someone explain me the math behind this paper and tell me whether the way I have understood this paper is right or not? by eternal-abyss-77
Sir, firstly thanks for responding.
I already have implemented this as a working program. But now I am enhancing it, and I have some feeling that I somehow am missing something from the paper, and not understanding it properly.
For example:
The equations [2, 4, 6, 8, 10, 15-18] in pages 3, 4 and 5
The training of the model with generated features with Linear LSE mentioned in page 6-7
And section B Local pixel difference descriptor, para 2 regarding directions. And it's related figures, Figure 3(a,b).
If you can explain these things, i can effectively understand your explanation and ask my doubts wrt my present work on this paper, with code.
onkus t1_iwfu0qq wrote
Reply to Can someone explain me the math behind this paper and tell me whether the way I have understood this paper is right or not? by eternal-abyss-77
So what are you asking?
eternal-abyss-77 OP t1_iwfrja8 wrote
Reply to comment by arhetorical in Can someone explain me the math behind this paper and tell me whether the way I have understood this paper is right or not? by eternal-abyss-77
Explain me equations 2 and 4 sir
How to design the identity matrices
[deleted] t1_iwfqky7 wrote
arhetorical t1_iwfq6kp wrote
Reply to comment by eternal-abyss-77 in Can someone explain me the math behind this paper and tell me whether the way I have understood this paper is right or not? by eternal-abyss-77
I think it's better if you ask specific questions, rather than ask people to explain the whole thing. The explanation in the paper seems pretty clear to me already...
Constant-Cranberry29 OP t1_iwlwjy8 wrote
Reply to comment by pornthrowaway42069l in How to normalize data which contain positive and negative numbers into 0 and 1 by Constant-Cranberry29
I have try, then it doesnt work.