Matthew's infancy narrative says Jesus' family was made rich by the wise men, Luke's knows no wise men and says the family offered the sacrifice for the poor

 

Now when Jesus was born in Bethlehem of Judaea in the days of Herod the king, behold, there came wise men from the east to Jerusalem ... And when they were come into the house, they saw the young child with Mary his mother, and fell down, and worshipped him: and when they had opened their treasures, they presented unto him gifts; gold, and frankincense, and myrrh.

-- Matthew 2:1, 11

And when the days of her purification according to the law of Moses were accomplished, they brought him to Jerusalem, to present him to the Lord; (As it is written in the law of the Lord, Every male that openeth the womb shall be called holy to the Lord;) And to offer a sacrifice according to that which is said in the law of the Lord, A pair of turtledoves, or two young pigeons.

-- Luke 2:22ff.

And if she be not able to bring a lamb, then she shall bring two turtles, or two young pigeons; the one for the burnt offering, and the other for a sin offering: and the priest shall make an atonement for her, and she shall be clean.

-- Leviticus 12:8

This is just one of the many problems raised by the infancy narratives, but it's also a problem specifically for Matthew who tells us Jesus grew up to insist

... That a rich man shall hardly enter into the kingdom of heaven. ... It is easier for a camel to go through the eye of a needle, than for a rich man to enter into the kingdom of God.

-- Matthew 19:23f.

That is one indication that Matthew's infancy narrative is an independent unit from the rest of his composition, which may have begun originally with chapter three with John the Baptist just like Mark, and that it was artlessly added after the fact.

From that one may take the Lukan infancy narrative as a corrective response, more harmonious with the Jesus who grows up to say

But woe unto you that are rich! for ye have received your consolation.

-- Luke 6:24

A Jesus angry with the exploitation of the poor shows up in the Cleansing of the Temple narratives, specifically overturning the tables of the sellers of doves in Matthew 21, Mark 11, and John 2.     

The near poverty of Jesus' family was shown by what Mary offered for her purification after Jesus' birth

Doves in America today run about $25 while ewe lambs run upwards of $500

 

 

  

And when the days of her purification according to the law of Moses were accomplished, they brought him to Jerusalem, to present him to the Lord; (As it is written in the law of the Lord, Every male that openeth the womb shall be called holy to the Lord;) And to offer a sacrifice according to that which is said in the law of the Lord, A pair of turtledoves, or two young pigeons.

-- Luke 2:22ff.

And when the days of her purifying are fulfilled, for a son, or for a daughter, she shall bring a lamb of the first year for a burnt offering, and a young pigeon, or a turtledove, for a sin offering, unto the door of the tabernacle of the congregation, unto the priest: ... And if she be not able to bring a lamb, then she shall bring two turtles, or two young pigeons; the one for the burnt offering, and the other for a sin offering: and the priest shall make an atonement for her, and she shall be clean.

-- Leviticus 12:6,8

Perhaps it was Jesus' personal experience of exploitation of his own family's poverty which lurks in the background to this passage where he speaks directly to the sellers of doves:

And found in the temple those that sold oxen and sheep and doves, and the changers of money sitting: And when he had made a scourge of small cords, he drove them all out of the temple, and the sheep, and the oxen; and poured out the changers' money, and overthrew the tables; And said unto them that sold doves, Take these things hence; make not my Father's house an house of merchandise. 

-- John 2:14ff.

See also:

And Jesus went into the temple of God, and cast out all them that sold and bought in the temple, and overthrew the tables of the moneychangers, and the seats of them that sold doves,  

-- Matthew 21:12

And they come to Jerusalem: and Jesus went into the temple, and began to cast out them that sold and bought in the temple, and overthrew the tables of the moneychangers, and the seats of them that sold doves; 

-- Mark 11:15

The detail is missing in Luke 19, where the cleansing of the temple is only a summary affair.