Misconceptions About Heat

When we touch something that is hot or cold, what are we actually sensing? Is it the temperature of the object, or the rate at which heat flows between the object and our hand?