Prime Minister Yousuf Raza Gilani of Pakistan on Friday refused to step down following his conviction for contempt by the Supreme Court, saying that only parliament had the right to force him from office.