Deputy PM admits former Soviet state was until recently a 'highly corrupt country' - but insists things are changing fast.