Adhesive for granite backsplash?

What kind of adhesive is BEST for installing a granite (not tile) backsplash and sidesplash? Someone told me to just use a laytex caulking, but that just doesn't sound right to me. It will be affixed to painted drywall.