Very upset with marriage?

I have been married for 21years....two years ago i found out through an astrologer that my husband has been flirting....he got caught....now the same astrologer told me that he is flirting with a married woman who has kids too. My husband has always been the type to do things together with me....do errands, have lunch ...dinner..and so on....we could sit together and have conversation for hours....we used to have every two weeks ...i am 45 and he is 46.....ours was a love marriage....now he is very quiet...everything i say is wrong....he does not smile, always serious...no jokes....yesterday i sat near him and asked him nicely....are u happy with this marriage....he says i am okay...and when i probed a little more...he said he hates me acting like this.....i really dont know what is goimg on....on fridays he leaves his office at 6pm.....and returns home at 6am...sat and sun...he is at home... When i am out of the hse, he is on his blackberry....he locks it when not using...i cant check it because it belongs to office....today i sent my mum a msg to say that i am hurt and sad...and that he is on the line when i am out of the hse....i also said he is up to no good.....i accidentally sent it to him too....i expected an outburst'''but there is no response from him.....am not speaking to him currently....at least for a few days...i dont know what is happening....pls help