>Is there a way in which I can develope lateral thinking,
>logical analysis and reasoning and apply them in mathematics
>so as to solve even the complex problems? What steps should
>I take?

A google.com search revealed several promising sites including one authorized by Edward de Bono himself

http://www.edwdebono.com/debono/

Several books of his are listed there, in particular, Lateral Thinking.

A search for "Roger von Oech" also produced several sites including a link to his own Creative Think:

http://www.creativethink.com/

Among books more specifically concerned with mathematics I may recommend Thinking Mathematically by John Mason and, of course, if you can get anyting by G. Polya, you'd get a delightful and fruitful source of mathematical wisdom.