How come sometimes I get 4 reputaion points and sometimes I get 8 from a user ?

How can I see how many points I got from each user ?

From what I see when you give reputation points, you don't have an option on how many points to give, so what makes it different for each user ?

Thanks