To imply is to suggest or hint at something.
To infer is to deduce something or to figure it out.
Joe says to Sam, "Sam, I don't think you got that money from legitimate investments."
Joe is implying that Sam is dishonest. Sam can infer that Joe doesn't trust him.