my replies, addressing your points,,,

"Moving forward, there is no guarantee it will keep going up, and it may even go down."

Trust me!

Do you think it is a good idea to buy it NOW ?

Yes!

"What makes you so confident it will keep going up ?"

There is NO solution to the debt problem that doesn't have consequences, and the consequences all lead to either currency devaluation or total monetary system collapse.

"But remember gold is more like "fear" money, it is about psychological"

Is Buffet your god? don't just take his words. 5000 years of fear and psychology?  It has got to be more than fear and psychology.

"it can be easily manipulated by government and other parties"

True, and it has been the case for decades, but nobody, no force on earth has been able to manipulate its price down to zero, not yet anyway.  The same can not be said for paper currenies though.

"it never brings real value and that's the dangerous part of it"

You need to define "true value", and apply your definition to gold and to a USD note. 

"Talking about its future it is 50/50 chance"

A theoretical truism, but a lazy excuse for a market participant.