Now liveThe Skillselion MCP - thousands of ranked skills, loaded into your agent mid-task. No install.Get it →
yuanyuanma03 avatar

Sd Search

  • 19 installs
  • 45 repo stars
  • Updated June 23, 2026
  • yuanyuanma03/academic-research-skills

Search ScienceDirect for academic papers by keyword, detecting the correct base URL including institutional proxies.

About

Navigates ScienceDirect search using the browser's current origin (direct or proxy) and extracts keyword results. A researcher uses it to find papers on Elsevier's ScienceDirect.

  • Detects direct vs institutional-proxy base URL
  • Uses an initScript and captcha handling to avoid bot detection

Sd Search by the numbers

  • 19 all-time installs (skills.sh)
  • Ranked #1,308 of 2,715 Automation & Workflows skills by installs in the Skillselion catalog
  • Data as of Aug 3, 2026 (Skillselion catalog sync)
npx skills add https://github.com/yuanyuanma03/academic-research-skills --skill sd-search

Add your badge

Show developers this skill is listed on Skillselion. Paste this into your README.

Listed on Skillselion
Installs19
repo stars45
Last updatedJune 23, 2026
Repositoryyuanyuanma03/academic-research-skills

What it does

Search ScienceDirect for academic papers by keyword, detecting the correct base URL including institutional proxies.

Files

SKILL.mdMarkdownGitHub ↗

ScienceDirect Basic Search

Search for academic papers on ScienceDirect using Chrome DevTools MCP.

Important: Determine the ScienceDirect base URL

Before the first operation, check the current browser page URL to determine which ScienceDirect domain the user is accessing. Store it as BASE_URL. Common patterns:

  • Direct access: https://www.sciencedirect.com
  • Institutional proxy: URL containing sciencedirect in the hostname (e.g. WebVPN or EZProxy)

Use whatever origin the user's browser is currently on. If no ScienceDirect page is open, ask the user which URL to use.

Steps

Step 1: Navigate to search results

Use navigate_page to go to:

{BASE_URL}/search?qs={QUERY}&show=25

Where {QUERY} is the URL-encoded search keywords from $ARGUMENTS.

Important: Always include initScript to prevent bot detection:

initScript: "Object.defineProperty(navigator, 'webdriver', {get: () => undefined})"

Step 2: Check access

After navigation, verify the page loaded correctly:

  • If the page shows "Are you a robot" or captcha: auto-click the Cloudflare Turnstile checkbox using the procedure below. If auto-click fails after 2 attempts, tell the user "请在浏览器中完成验证后告知我。"
  • If the URL no longer contains sciencedirect or search, the user may have been redirected to a login/authentication page. Tell the user: "页面被重定向,请在浏览器中完成登录或认证后告知我。" Then wait.
  • Otherwise, proceed.
Cloudflare Turnstile auto-click procedure

When a captcha page is detected (title "请稍候…" or body contains "Are you a robot"):

1. Wait for the Turnstile iframe to load — use evaluate_script to poll for #captcha-box (up to 8s). 2. Take a snapshot — use take_snapshot to get the a11y tree. The checkbox is inside a cross-origin iframe but Chrome DevTools MCP can see it:

   Iframe "包含 Cloudflare 安全质询的小组件"
     checkbox "确认您是真人"   ← target uid

3. Click the checkbox — use click(uid) on the checkbox element. 4. Wait and verify — wait 3-5s, then check if document.contentType changed or the page URL changed (indicating success). If still on captcha, retry once or fall back to asking the user.

Step 3: Extract search results

Use evaluate_script with built-in waiting. Do NOT use wait_for — it returns the full page snapshot which can exceed token limits (250K+ chars) on ScienceDirect pages.

async () => {
  // Wait for results to load (up to 10s)
  for (let i = 0; i < 20; i++) {
    if (document.querySelector('li.ResultItem') || document.querySelector('.search-body-results-text')) break;
    await new Promise(r => setTimeout(r, 500));
  }

  const items = document.querySelectorAll('li.ResultItem');
  const papers = [];

  for (let i = 0; i < items.length; i++) {
    const item = items[i];
    const titleLink = item.querySelector('a.result-list-title-link');
    const journal = item.querySelector('a.subtype-srctitle-link');
    const dateSpans = item.querySelectorAll('.srctitle-date-fields > span');
    const date = dateSpans.length > 1 ? dateSpans[dateSpans.length - 1].textContent.trim() : '';
    const authors = [...item.querySelectorAll('.Authors .author')].map(a => a.textContent.trim());
    const doi = item.getAttribute('data-doi');
    const pii = titleLink?.href?.match(/pii\/(\w+)/)?.[1] || '';
    const articleType = item.querySelector('.article-type')?.textContent?.trim() || '';
    const isOpenAccess = !!item.querySelector('.access-label');

    papers.push({
      rank: i + 1,
      title: titleLink?.textContent?.trim() || '',
      pii,
      doi: doi || '',
      journal: journal?.textContent?.trim() || '',
      date,
      authors,
      articleType,
      openAccess: isOpenAccess,
    });
  }

  const totalText = document.querySelector('.search-body-results-text')?.textContent?.trim() || '';
  const pageInfo = document.querySelector('.Pagination li:first-child')?.textContent?.trim() || '';

  return { papers, totalResults: totalText, pageInfo };
}

Step 4: Present results

Format results as a numbered list:

Found {totalResults}. {pageInfo}

1. {title}
   Authors: {authors}
   Journal: {journal} | {date}
   DOI: {doi} | PII: {pii}
   Type: {articleType} | Open Access: {yes/no}

2. ...

Key CSS Selectors

ElementSelector
Result itemsli.ResultItem
Title linka.result-list-title-link
Journal linka.subtype-srctitle-link
Authors.Authors .author
Date.srctitle-date-fields > span (last span)
DOIdata-doi attribute on li.ResultItem
Article type.article-type
Open access indicator.access-label
Total results.search-body-results-text
Checkbox (for batch ops).checkbox-input (id = PII)
Next page link.next-link a

URL Parameters

ParamDescriptionExample
qsQuery stringdeep learning
showResults per page25, 50, 100
offsetPagination offset0, 25, 50
sortBySort orderdate (omit for relevance)

Notes

  • Results include PII identifiers needed for detail extraction, PDF download, and citation export.
  • Each result checkbox id equals the PII, used for batch export/download.
  • This skill performs at most 2 tool calls: navigate_page + evaluate_script.

Related skills

This week in AI coding

Five minutes, every Monday - the tools, releases and tactics for developers.

unsubscribe anytime.