That doesn't mean Brown is out of a job though.
"I'm still a returner, I just didn't get any returns this week," Brown said. "I guess coaches wanted to try something new, but we're both still back there."
Coach Tony Ball said he made the decision to give Samuel a shot at return duties because he liked the freshman's physical style and thought the competition would help both players.
"I felt like (Samuel) could give me another dimension, and that's the reason why he was there and he's earned the opportunity," Ball said. "But (Brown) still gives me that one-two punch."
Ball said the two returners have different styles that allow him to plug in a return man to fit each specific situation.
"(Brown) is more of a speed-finesse guy, and Richard is more of a speed-power guy," Ball said. "They're two different type guys but both are capable of doing a good job."