What Actually learn English

I have spent a large amount of time learning English. However, I recently think of these time as handicap to me because those lengthy time wasn't exist if I were born in a English speaking country or Japanese was a dominant language in the world. Of course, I don't mean to criticize the unfairness of this situation, but I just decided to learn English in the way I learn not only English language but also something as English speakers do. I'm fed up with getting stupid examples of conversations, but now I don't have any other options to learning how to speak while learning something useful. I found the ways for the other aspects of learning English already. About reading, I'm already capable of reading lengthy and academic article, and that will empower my knowledge while improving my reading skills. And about listening, I mainly watch or just listen audio that is interesting and knowledgeable, by doing that, I can improve my listening skills while improving my listening skill. Next, about writing skill, well this is not complete way, but I write about anything including this blog. By writing a lot and lot, I can improve my writing skill in English while I impart what I have or organize my thought or take a note in English. This is incomplete because I don't have someone to revise my article or essay so that I am not completely sure mine is correct. But I think this concern will be gone after I keep doing this for a certain amount of time.
Next, this is the problem, I don't have a way of learning speaking skill. Of course if I just want to learn speaking English language, I have a lot of ways to practice, such as Skype, shadowing as I always do, go to conversation English and etc. But in terms of learning more than 2 things as English speakers do, it is difficult that I have not found it yet. The ideal way is that I was in the environment where there are English speakers around me, and they learn Computer science as well!! And taking same courses! If that was possible, I could argue about the problems or talk about the future of CS, and something I do with my friends now, But this is now impossible, Japanese Universities failed to collect students as much countries as possible. We only have Japanese almost unlike the best universities like MIT or Harvard. I feel a little pity for that, but I will change this situation by going abroad. But for doing that, I have to again learn English for only English language again, TOEFL. But this is necessary anyway.
Good university like MIT should have a variety of people from all over the world, and have a liberal and fun environment that people of different majors can get together and accept any ideas that now seems impossible or not practical.