Nigeria, the seventh most populous country in the world, is plagued by livelihood challenges such as poverty and food insecurity, which are more pervasive among farming households and rural communities. Organic farming is being promoted by some domestic non-governmental organizations as a means of addressing the problem of poverty and food insecurity among farming households and rural communities in the country. Promoters consider organic farming to be well-suited to smallholder farmers’ socio-economic conditions in Nigeria, and that it can help improve their livelihood conditions through increased agricultural productivity and farm income. However, the adoption of the technology by smallholder farmers has been underwhelming, for reasons yet to be studied. Using a livelihood framework and through a case study of farmers in Ibadan, Oyo State, this study qualitatively explores and provides insights into the factors that influence, constrain, and gender the adoption of organic farming in Nigeria. Overall, it was found that a mix of factors, which include institutional considerations, farmers’ livelihood assets and vulnerability contexts, their livelihood activities, and gender-related variables shaped adoption decision-making. The policy implications of the findings were outlined.