It is natural to be concerned about the possibility of your past affecting your new life.
However, when it comes to Hong Kong Immigration Department, you should not be too worried about your past mistake.
Of course, they care about security threats and risks that a person with a criminal record may pose to the society, but their response to most cases seems to be quite forgiving.
Moreover, there are no formal requirements at any point of your visa application (whether it be student, employment, investment or Right of Abode) to disclose your criminal history, unless the Immigration Department asks for it specifically.
However, once you are in Hong Kong, any illegal activity would have a strong impact on your future in the city.