When is the right time to refinance? If you’re current mortgage rate is in the mid 4’s or higher or if you are currently in an adjustable rate mortgage, or if you are considering shortening your mortgage term, then you may want to consider your refinance options. Mortgage rates are at historic lows and have been for some time due to the Fed’s purchase of mortgage backed securities.