The Bluebirds men sit 19th in the Premier League after falling to a comprehensive 3-0 defeat to south Wales rivals Swansea City on Saturday.
Cardiff have shipped 44 goals in the league this season, the second-most in the division, and have conceded in each of their last nine league games, a lack of solidity that has disappointed their new boss.
|CARDIFF CITY LATEST
|10/3||Aston Villa are 10/3 with William Hill to score in both halves against Cardiff|
"We have also conceded too many goals at home, although Saturday's game was the first time we have gone in level at half-time under me.
"The second half was disappointing so this is something that we have to address. We simply have to stop letting in the amount of goals we are at the moment.
"Villa at home is a chance to get points but Villa are a very good away team and we know we are facing a tough team."
The Norwegian left Craig Noone out of the squad against Swansea because of a minor injury but expects the winger to return for the visit of Paul Lambert's men.
"Craig was struggling with a slight injury and we had to look after him," Solskjaer added. "I think he will be available to face Villa but he needed a rest."