You can only claim the interest on money borrowed for investment purposes.
The $200k loan related to a property purchase but you paid it down to $120k. So only $120k of this loan relates to the property. $80,000 relates to a new property which you live in. So on the face of it only $120k...