A Long Island man was arrested Tuesday after shoving a security guard while trying to steal merchandise from a Target, according to Nassau County police.