Sometimes, I think we evangelicals stress the biblical idea that "all people are sinners" (Romans 3:10) so much that we forget that unregenerate (non-Christians) can do good (in the sense below) and please God. I think we need to be reminded of the Reformed doctrine of "common grace".
Below are two quotes from Louis Berkhor, stressing the fact that 1) Unregenerates can do good and 2) God does show favor to them.
"Reformed theologians generally maintain that the unregenerate can perform natural good, civil good, and outwardly religious good. They call attention to the fact, however, that, while such works of the unregenerate are good from a material point of view, as works which God commanded, they cannot be called good from a formal point of view, since they do not spring from the right motive and do not aim at the right purpose. The Bible repeatedly speaks of works of the unregenerate as good and right, II Kings 10:29, 30; 12:2 (comp. II Chron. 24:17-25); 14:3,14-16,20,27 (comp. II Chron. 25:2); Luke 6:33; ROM 2:14,15."
"Another objection to the doctrine of common grace is that it presupposes a certain favorable disposition in God even to reprobate sinners, while we have no right to assume such a disposition in God....Evidently the elect can not be regarded as always and exclusively the objects of God´s love. And if they who are the objects of God´s redeeming love can also in some sense of the word be regarded as the objects of His wrath, why should it be impossible that they who are the objects of His wrath should also in some sense share His divine favor? A father who is also a judge may loathe the son that is brought before him as a criminal, and feel constrained to visit his judicial wrath upon him, but may yet pity him and show him acts of kindness while he is under condemnation. Why should this be impossible in God? General Washington hated the traitor that was brought before him and condemned him to death, but at the same time showed him compassion by serving him with the dainties from his own table. Cannot God have compassion even on the condemned sinner, and bestow favors upon him? The answer need not be uncertain, since the Bible clearly teaches that He showers untold blessings upon all men and also clearly indicates that these are the expression of a favorable disposition in God, which falls short, however, of the positive volition to pardon their sin, to lift their sentence, and to grant them salvation. The following passages clearly point to such a favorable disposition: Prov. 1:24; Isa. 1:18; Ezek. 18:23,32; 33:11; Matt. 5:43-45; 23:37; Mark 10:21; Luke 6:35: ROM 2:4; I Tim. 2:4. If such passages do not testify to a favorable disposition in God, it would seem that language has lost its meaning, and that God´s revelation is not dependable on this subject."