Sex, Lives and Red Tape

Reviewing the literature: broad versus systematic approaches

In starting my literature review, I decided a good first step would be to look at some examples – what have others done? what should the final product look like?

Luckily, at UCL there is the brilliant resource of UCL Discovery which is a depository of research (from completed theses to publications and conference papers…etc). It lists EVERY PhD thesis which has been completed from 1919 to 2014. Information provided includes the name of the author, title of their PhD thesis, and in many cases a PDF version of the final document. Brilliant!

Having selected a few theses titles which looked vaguely “public health-y”, I was somewhat surprised with how the authors had approached and presented their literature review sections. The first few I skimmed over had clear references, but there was no explanation as to how they approached their literature review. I wondered whether this information was in the appendices (a flow chart of databases searched, inclusion and exclusion criteria); no such luck. To give an example, one thesis noted:

This section provides a broad overview of the research area investigated in this thesis

Taking a broad approach

If one takes a “broad overview” how do they select the information to be included, and more importantly, how do they decide what information to exclude? Surely this approach is open to bias (which is never a good thing in research).

There are some topics and literature (particularly grey literature) which may be less easily identified through a systematic method – and thus a broad approach is more likely to result in finding relevant information. Secondly, there are those occasions when you are limited by time and space (e.g. a journal publication) where a broad approach of picking the most relevant evidence to your topic makes the most sense.

Taking a systematic approach

In my public health training (MPhil in Public Health and 3 years as a registrar) I have learnt that for any topic one should always review the evidence (what do we already know? how credible is the evidence? what is still unknown?) and use a systematic approach. This approach helps me grasp what is currently known on a topic, aids decision making (is the information credible?), and transparent methods allow others to replicate my search to assess/update the review.

State your method!

My observations from recently published PhD theses suggest that some researchers approach the literature review with less rigour compared to the presentation of the remainder of their thesis – perhaps the literature review is not always perceived to be as important comparative to the other thesis sections (it shouldn’t contain anything original, thats for sure).

There is a word limit and time limit with a PhD, but it is my view that both are flexible enough to accommodate the inclusion of a brief description of methods. Where a systematic approach was taken, then it is important to share your approach – however even if you choose a broad approach (or a mixture of both, which I expect I’m likely to do) a short sentence explaining your approach, and perhaps the limitations of your approach, would be useful to the reader.

What do you think? Is my suggestion reasonable?

Advertisements

3 comments on “Reviewing the literature: broad versus systematic approaches

  1. Dunc
    February 3, 2014

    Does this come back to aims? If your aim is to answer a specific policy question then reproducability and being systematic is proably more important than bredth. If your aim is to develop new knowledge and new insight then it’s probably worth picking up on research with outside of your original search frame. Not that I know much about the aims of a PhD – I suspect there’s a whole multitude of them!

    If you can deal with the work of sifting or get other people involved then a systematic review might give a good early paper, though…

  2. carotomes
    February 3, 2014

    Good point – it probably does come back to the aims of the report, and one PhD thesis aim is to do original research. I’m fairly new to this PhD malarky too – just wanted to share the observation that many theses spend much time describing what they did, what they found, and the implications of these findings… and it struck me as strange that many introductory chapters launch straight into summarising what is known, without telling me how they identified the information.

    I guess I’m wondering if you can cover breadth and be systematic at the same time? (e.g. journals say …. grey literature highlights… other sources include…) …And is this the ideal, or is it ok to cherry-pick the literature you review for a PhD? When the objective of a PhD is to answer a research question, is it not important to ensure that is a true gap in knowledge via systematic approach to the literature review?

  3. carotomes
    February 3, 2014

    There is a good discussion of the issue here (unfortunately, not open access):

    D. Badger , J. Nursten , P. Williams & M. Woodward (2000) Should All Literature Reviews be Systematic?, Evaluation & Research in Education, 14:3-4, http://www.tandfonline.com.libproxy.ucl.ac.uk/doi/pdf/10.1080/09500790008666974

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s