Asymmetric dark current and photocurrent versus voltage characteristic in the Double Barrier Quantum Wells (DBQWs) photovoltaic infrared photodetector has been studied. A model based on asymmetric potential barriers was proposed. The asymmetric potential thick barrier, which due to the Si dopant segregation during growth makes a major contribution to the asymmetrical I-V characteristic, calculations based on our model agree well with experimental results. This work also confirms the potential use of this DBQWs for infrared photodetector with large responsivity and little dark current under negative bias.