OBJECTIVES: To methodologically review the published literature on rheumatoid arthritis multiple treatment comparison meta-analysis (MTCs). To identify methodological issues that can explain the substantial discrepancies in the findings of these MTCs. METHODS: We searched MEDLINE for rheumatoid arthritis multiple treatment comparisons. Following the PRISMA guidelines, we extracted a large set of methodological items from the identified reviews. These included, but were not limited to, inclusion/exclusion criteria, information sources (e.g., MEDLINE), approaches to dealing with monotherapies versus combination therapies, approaches to dealing with potential covariate effect modifiers (i.e., sources of heterogeneity). RESULTS: We identified 11 published MTC, of which 7 were published since 2009. We identified major discrepancies in the inclusion of trials, despite highly similar eligibility criteria and literature searches. The total number of trials covered among all MTCs was 61. The number of trials, however, included in the individual MTCs published since 2009 spanned from 15 to 31 – i.e., 25%-50% of all available trials. We identified inconsistencies in approaches to dealing with monotherapy and combination therapy trials. Most MTCs lumped the two sets of trials without either controlling for the effect of concomitant use of disease modifying anti rheumatic drugs (DMARDs) or separately comparing the effectiveness estimates in the two. Approximately half of the identified MTCs did not explore potential sources of heterogeneity. Among those that did, the explored sources were inconsistent. CONCLUSIONS: Major methodological shortcomings and inconsistencies exist throughout published rheumatoid arthritis MTCs. There are many lessons to be learned from these previous publications which can potentially strengthen the current evidence base.