A vision statement describing goals for Ecology @ESAEcology #openscience

Many aspects of the journal Ecology are exceptional.  It is a society journal and that is important. The strength of research, depth of reporting, and scope of primary ecological research that informs and shapes fundamental theory has been profound.  None of these benefits need to change.  Nonetheless, research that supports the scientific process and engenders discovery can always evolve and must be fluent.  So must the process of scientific communication including publications through journals.  With collaborators and support from NCEAS and a large publishing company, I have participated in meta-science research examining needs and trends in the process of peer review for ecologists and evolutionary biologists, i.e. Behind the shroud: a survey of editors in ecology and evolution published in Frontiers in Ecology and the Environment or biases in peer review such as Systematic Variation in Reviewer Practice According to Country and Gender in the Field of Ecology and Evolution published in PLOS ONE.  In total, we have published 50 peer-reviewed publications describing a path forward for ecology and evolution in particular with respect to inclusivity, open science, and journal policy.  Ideally, we have identified at least three salient elements for journals relevant to authors, referees, and editors, and four pillars for a future for scholarly publishing more broadly.  The three elements for Ecology specifically would be speed, recognition, and more full and reproducible reporting.  The four pillars include an ecosystem of products, open access, open or better peer review, and recognition for participation in the process .

 

Goals to consider

  1. Rapid peer review with no more than 4 weeks total for first decision.
  2. A 50% editor-driven rejection rate of initial submissions.
  3. Two referees per submission if in agreement (little to no evidence more individuals are required).
  4. Double the 2017 impact factor to ~10 within 2 years and return to top 10 ranking in 160 of journals listed in field of ecology.
  5. Further diversify the contributions to address exploration, confirmation, replication, consolidation, & synthesis.
  6. Innovate content offering to encompass more elements of the scientific process including design, schemas, workflows, ideation tools, data models, ontologies, and challenges.
  7. Allow authors to report failure and bias in process and decision making for empirical contributions.
  8. Provide additional novel material from every publication as free content even when behind paywall.
  9. Develop a collaborative reward system for the editorial board that capitalizes on existing expertise and produces novel scientific content such as editorials, commentaries, and the reviews as outwardly facing products. Include and invite referees to participate in these ‘meta’ papers because reviews are a form of critical and valuable synthesis.
  10. Promote a vision of scientific synthesis in every publication in the Discussion section of reports. Request an effect size measure for reports to provide an anchor for future reuse (i.e. use the criteria proposed in ‘Will your paper be used in a meta‐analysis? Make the reach of your research broader and longer lasting’).
  11. Revise the data policy to require data deposition – at least in some form such as derived data – openly prior to final acceptance but not necessarily for initial submission.
  12. Request access to code and data for review process.
  13. Explore incentives for referees – this is a critical issue for many journals. Associate reviews with Publons or ORCID.
  14. Emulate the PeerJ model for badges and profiles for editors, authors, and
  15. Remove barriers for inclusivity of authors through double-blind review.
  16. Develop an affirmative action and equity statement for existing publications and submissions to promote diversity through elective declaration statements and policy changes.
  17. All editors must complete awareness training for implicit bias. Editors can also be considered for certification awarded by the ESA based on merit of reviewing such as volume, quality of reviews, and service. Recognition and social capital are important incentives.
  18. Develop an internship program for junior scientists to participate in the review and editorial process.
  19. Explore reproducibility through experimental design and workflow registration with the submission process.
  20. Remove cover letters as a requirement for submission.

Outcomes

I value our community and the social good that our collective research, publications, and scientific outcomes provide for society.  However, I am also confident that we can do more.  Journals and the peer review process can function to illuminate the scientific process and peer review including addressing issues associated with reproducibility in science and inclusivity.  Know better, do better.  It is time for scientific journals to evolve, and the journal Ecology can be a flagship for change that benefits humanity at large by informing evidence-based decision making and ecological literacy.

 

Controls, controls everywhere, and change continues nonetheless

Typically, everyone chases experimental treatments – i.e. direct interventions – as the fundamental means to advance science. We do something to one set of subjects whether plants, animals, or people, and we monitor the other set designated as controls.  The paper ‘Ambient changes exceed treatment effects on plant species abundance in global change experiments‘ very nicely shows that in many if not all natural systems, the ‘controls’ change too.  We cannot ignore the fact that natural ecosystems are changing just as rapidly and just as much due to global change and climate as the treatments we might test.
Solution – do the work and check!

Significant ‘developments’ this last few days associated with how we use lands #evidence #synthesis

This last week has been busy with numerous evidence syntheses highlighting that location, location, location and land use patterns are critical issues.

(1) ‘North American diets require more lands than we have’ was published in PLOS ONE and discussed widely. A compelling map of land spared showed little remains.

(2) On the other side of the coin, retiring lands because of water regulations, limitations, and drought are an opportunity for conservation and restoration was published in Ecosphere. Tools mapped for California studying three endangered animal species highlighted that we do know enough to begin to make evidence-based decisions for strategic retirement.

(3) A compelling map of how America uses land was published at Bloomberg.

(4) Hydraulic fracking is now being considered in the region used a case study for the retired land synthesis in #2 listed above including a map of proposed lands open for leasing.

Implications

(a) Scientific synthesis rapidly advances the big picture and both different synthesis tools (maps, systematic reviews, and ideally meta-analyses too) and syntheses with different purposes facilitate a more balanced weighting of issues. Even better, reproducible syntheses provided by different sets of stakeholders would elevate discussion and decision making.

(b) Agriculture, restoration, and energy development (both sustainable and non) must be better balanced through contrasted, transparently aggregated evidence.

(c) The ecological services and functions we get from lands ‘for free’ are precarious and precious.

(d) Whilst we cannot ignore human needs (and their likelihood of continued increases),  it is hard not to imagine that a buffer for other living creatures should also be factored into proposed land use trajectories.

(e) Ecology, socioeconomics, and other fields need to much more rapidly crunch current evidence because the clock is ticking.

 

Ecological network flavors: many-to-many, few-to-many, and few-to-many spatially

Recent conference attendance inspired me to do a quick typology of networks that were presented in various talks. All were done in R using a few different packages.
All were interested in diversity patterns.
None were food webs.

Networks

many-to-many: many plant species and many pollinators for instance

few-to-many: mapping the associated set of pollinators to one flowering species

few-to-many: replicated mapping of diversity for one taxa to a single species of another either nested or spatially contrasted.

 

Network analyses are amazing. I need to learn more!

Can you also map interactions onto other interactions?

 

 

Hacking the principles of #openscience #workshops

In a previous post, I discussed the key elements that really stood out for me in recent workshops associated with open science, data science, and ecology. Summer workshop season is upon us, and here are some principles to consider that can be used to hack a workshop. These hacks can be applied a priori as an instructor or in situ as a participant or instructor by engaging with the context from a pragmatic, problem-solving perspective.

Principles

1. Embrace open pedagogy.
2. Use and current best practices from traditional teaching contexts.
3. Be learner centered.
4. Speak less, do more.
5. Solve authentic challenges.

Hacks (for each principle)

1. Prepare learning outcomes for every lesson.

2. Identify solve-a-problem opportunities in advance and be open to ones that emerge organically during the workshop.

3. Use no slide decks. This challenges the instructor to more directly engage with the students and participants in the workshop and leaves space for students to shape content and narrative to some extent. Decks lock all of us in. This is appropriate for some contexts such as conference presentations, but workshops can be more fluid and open.

4. Plan pauses. Prepare your lessons with gaps for contributions.  Prepare a list of questions to offer up for every lesson and provide time for discussion of solutions.

5. Use real evidence/data to answer a compelling question (scale can be limited, approach beta as long as an answer is provided, and the challenge can emerge if teaching is open and space provided for the workshop participants to ideate).

Final hack that is a more general teaching principle, consider keeping all teaching materials within a single ecosystem that then references outwards only as needed. For me, this has become all content prepared in RStudio, knitted to html, then pushed to GitHub gh-pages for sharing as a webpage (or site). Then participants can engage in all ideas and content including code, data, ideas in one place.