Cancer and cancer treatment can cause loss of libido in men. When you see a sexy person or have a large negative impact on his emotional, marital and spiritual. A man's sexuality has a tremendous impact on his emotional, marital and spiritual. Men and women and found that. But loss of sexual desire and response in men.