Hi,
If your business force you to use not equal to ( != ) operator in select, you don't have a choice 
. As by standard, BSEG is transparent and columnar, you can think of applying filter on non primary fields also. I dont suggest reading the data , and then apply a NE in internal table ( push down buddy )
Sree