Using a GTX 1050ti on TensorFLow For Machine Learning

[UzuShin]

Hello guys.

Are there any Machine Learning/Neural Network Experts/Enthusiasts or computational scientists here?

It would be really cool to talk about machine learning with fellow enthusiasts.


I am a sophomore at NSU studying CSE.
This semester I took two courses CSE440 (Artificial Intelligence) and CSE465(Pattern Recognition and Neural Networks).

We are like 1/3rd through our course and so far I have grasped the basics of machine learning.
We coded mostly on octave so far
I implemented gradient descent and used it to optimize "thetas" for linear regression.
Then used optimizers like fminuc for larger data sets for logistic/linear regression.
I also implemented a neural network that classifies digits(1-9) from images. (A Coursera assignment most of the work was already done)

So it would be fair to say I am an absolute novice.

We will be moving to python and use TensorFlow libraries soon.

So I thought of checking out TensorFlow early on.
I was thinking of using the GPU version of TensorFlow.

I have a 1050ti and want to use that since it is supported.

Now what I wish to know is that would it be sufficient( i.e better than CPU will do) in working with med-large sized data?

I don't know the specifics but our Faculty will give us an optional project on Deep Neural Network.

He told us to have at least 8gb of ram (I have 16 so no problem there).

However for the case of my GPU it only has 4gb of vram. What happens if your data surpasses that?
Will the rest of the memory be cached in the system ram then?
Or will I not be able to use my GPU at all in cases like that.

( I can and will look these stuff up. Just would be nice to talk to people in Bangladesh)

[shafi]

I have a friend who worked for IBM canada and now will be going to join Nvidia within next few months. His work was completely based on machine learning and he told me a powerful gpu help. Since I still am kinda noob about machine learning, I won't be able to provide a more specific answer to your question. Just an experience.

[UzuShin]

I have a friend who worked for IBM canada and now will be going to join Nvidia within next few months. His work was completely based on machine learning and he told me a powerful gpu help. Since I still am kinda noob about machine learning, I won't be able to provide a more specific answer to your question. Just an experience.

Yeah I read that too.. GPUs are a loooot faster than CPUs.. I plan on getting a better GPU in the future. This'll have to do for now :')

Do check out ML.. I barely any experience myself but I am loving it so far! This is the future~

One thing is for sure.. Not gonna buy an AMD GPU anytime soon xD

[shafi]

Yeah I read that too.. GPUs are a loooot faster than CPUs.. I plan on getting a better GPU in the future. This'll have to do for now :')

Do check out ML.. I barely any experience myself but I am loving it so far! This is the future~

One thing is for sure.. Not gonna buy an AMD GPU anytime soon xD

Yeah ML is really fun from what i get as limited exposure to it. But for us it is kind of a 4th year course(third year course for computer science students) so I plan to take some coursera courses and then work on it.

Yeah I do agree it is the future, there is a huge research and work going on both in US and here in Canada.

[SadmanBD]

One thing is for sure.. Not gonna buy an AMD GPU anytime soon xD

https://rocm.github.io/dl.html

[FCIP1]

You need at-least a 1070 to do anything medium to large.

And if you actually go over the 4G Vram, you will start using your system memory which is really really slow compared to GDDR5.

[UzuShin]

Yeah ML is really fun from what i get as limited exposure to it. But for us it is kind of a 4th year course(third year course for computer science students) so I plan to take some coursera courses and then work on it.

Yeah I do agree it is the future, there is a huge research and work going on both in US and here in Canada.

It's a 4th year course here too. I just took it early.
I'd recommend Dr Andrew Ng's machine learning course in Coursera. I am halfway done with it and it's really good.

https://rocm.github.io/dl.html

Ahh that's cool nice to see there is an AMD alternative. Hope it grows.
But for a novice like me I'll stick to Cuda since it has much much more support.

You need at-least a 1070 to do anything medium to large.

And if you actually go over the 4G Vram, you will start using your system memory which is really really slow compared to GDDR5.

Well can't buy a 1070 out of the blue :'( ... Will have to deal with this for now. As long as it is better than using the CPU I am happy.

[FCIP1]

I have another question, How did you take this so quickly? I mean I am pretty sure AP system isn't used in BD

[UzuShin]

I have another question, How did you take this so quickly? I mean I am pretty sure AP system isn't used in BD

I did another course with my Faculty so it was easy to get his recommendation. I submitted an application to the department chair and got the courses.
AP system? I am sorry I am not familiar with the term :S

AI/ML/Big-Data doesn't have much of a presence in BD. But it is taking the world by storm. I am sure it'll trickle down to BD eventually.

[FCIP1]

I see. What you just did is AP (Advance Placement) basically taking courses faster than recommended period.

Anyway I also have some interest in AI and Machine learning, but have literary zero idea about them? Could you tell me how to get started in this? Currently a freshman in BracU Cse.

[shafi]

I see. What you just did is AP (Advance Placement) basically taking courses faster than recommended period.

Anyway I also have some interest in AI and Machine learning, but have literary zero idea about them? Could you tell me how to get started in this? Currently a freshman in BracU Cse.

I would suggest take the coursera course with andrew ng. A lot of my Ubc friends have started with him. Cousera coursese hand down provide way better experience compared to youtube or other online platforms. I think it is 65 cad per month but Sooner you finish the less u pay.

- - - Updated - - -

I did another course with my Faculty so it was easy to get his recommendation. I submitted an application to the department chair and got the courses.
AP system? I am sorry I am not familiar with the term :S

AI/ML/Big-Data doesn't have much of a presence in BD. But it is taking the world by storm. I am sure it'll trickle down to BD eventually.

i higly doubt it will come to bd. We still donot have corporate offices for companies like amazon, let alone a burgeoning startup industry. Due to political instability no companies want to invest in bd.

[UzuShin]

I see. What you just did is AP (Advance Placement) basically taking courses faster than recommended period.

Anyway I also have some interest in AI and Machine learning, but have literary zero idea about them? Could you tell me how to get started in this? Currently a freshman in BracU Cse.

Ahh, well firstly I am assuming you are moderately proficient with Data-structures and algorithms as you'll be relying on them heavily to implement many AI algorithms. You should also refresh your "Probability and Statistics" knowledge (you should try taking the math course asap) as this plays a massive role in decision making.

If you have these covered check out the Artificial Intelligence Course by Dr. Sebastian Thrun and Dr. Peter Norvig on Udacity.
It is a free course just you need to pay to get a degree(optional)

As for ML.. Make sure to brush up on your "Linear Algebra" (ML is all about manipulation of vectors and matrices)
Then as @shafi suggested you can take the Andrew Ng's coursera course. It's like the go to course for any ML beginner.
It's a free course as well just if you want a degree you will have to pay about 80$(have to check the exact amount)

I would suggest take the coursera course with andrew ng. A lot of my Ubc friends have started with him. Cousera coursese hand down provide way better experience compared to youtube or other online platforms. I think it is 65 cad per month but Sooner you finish the less u pay.

- - - Updated - - -



i higly doubt it will come to bd. We still donot have corporate offices for companies like amazon, let alone a burgeoning startup industry. Due to political instability no companies want to invest in bd.

I guess outsourcing or leaving the country are my only options q.q....