Pagination and returning data from tables to view

i have basic tables and when i run my queries, typically it only has one
condition and no parent/child tables associated with it. when will the
size of the return results from the table start to become a problem
using the basic paginator helper? if i am only returning < 100 results,
would there be a problem?

thanks