DNS & HTTP Analysis for semrush.com

Processing Domain semrush.com on 20/06/2019 08:05:24


  • This tool is available free to use at GENSupport
  • Help and Support for your DNS or HTTP issues available on our Forum
  • Whenever you see a clicking on it will take you to more help
  • The version of the data model that was used in this report is 1.008
  • The version that produced this report is 1.022b

Processing DNS Records

Basic Checks

Here we check the basic functioning and security of your DNS

  • Zone Queries 6 Record Types and 17 Records Found
  • Zone Transfer Failed
  • Zone Dump
    • TXT
      • _dmarc.semrush.com. TTL 300 "v=DMARC1;p=none;sp=none;adkim=r;aspf=r;rua=mailto:This email address is being protected from spambots. You need JavaScript enabled to view it.;fo=1"
      • semrush.com. TTL 60 "google-site-verification=Jdyk-VWECYqQ7-puXdoLoGp7U629HhAnurYQcRavu90"
      • semrush.com. TTL 60 "google-site-verification=N92wr1UtG9CBIK7ZKs-RPz5BK6hi5Wnd8IjOAzqy63s"
      • semrush.com. TTL 60 "v=spf1 mx include:_spf.google.com include:spf.mandrillapp.com include:mta1ip.mindbox.cloud include:mta2ip.mindbox.cloud ip4:205.201.128.0/20 ip4:198.2.128.0/18 ip4:148.105.8.0/21 ip4:192.243.55.0/24 include:_spf.salesforce.com ~all"
    • NS
      • semrush.com. TTL 3600 ns-1063.awsdns-04.org.
      • semrush.com. TTL 3600 ns-2037.awsdns-62.co.uk.
      • semrush.com. TTL 3600 ns-246.awsdns-30.com.
      • semrush.com. TTL 3600 ns-850.awsdns-42.net.
    • A
      • semrush.com. TTL 5 104.18.69.106
      • semrush.com. TTL 5 104.18.70.106
    • MX
      • semrush.com. TTL 86400 1 aspmx.l.google.com.
      • semrush.com. TTL 86400 10 alt3.aspmx.l.google.com.
      • semrush.com. TTL 86400 10 alt4.aspmx.l.google.com.
      • semrush.com. TTL 86400 5 alt1.aspmx.l.google.com.
      • semrush.com. TTL 86400 5 alt2.aspmx.l.google.com.
    • SOA
      • semrush.com. TTL 900 ns-1063.awsdns-04.org. awsdns-hostmaster.amazon.com. 1 7200 900 1209600 86400
    • CNAME
      • www.semrush.com. TTL 300 www.semrush.com.cdn.cloudflare.net.

Nameservers

Here we check the setup of your nameservers. All nameservers on your domain should be listed in the zone and returned in an ANY query along with corresponding A and/or AAAA records resolving their address.

  • ns-1063.awsdns-04.org 205.251.196.39 Found and Match. (Missing from Zone Address Records )
  • ns-2037.awsdns-62.co.uk 205.251.199.245 Found and Match. (Missing from Zone Address Records )
  • ns-246.awsdns-30.com 205.251.192.246 Found and Match. (Missing from Zone Address Records )
  • ns-850.awsdns-42.net 205.251.195.82 Found and Match. (Missing from Zone Address Records )
  • All Name Servers on Different Subnets

Processing 4 TXT Records

DMARC Record:

The DMARC Record defines how MTA's should response when parsing DKIM and SPF records

  • v=dmarc1 (The Version of this record)
  • p=none (The Policy to implement on FAIL)
  • sp=none (The Policy to implement for subdomains on FAIL)
  • adkim=r (Alignment mode for DKIM)
  • aspf=r (Alignment mode for SPF)
  • rua=mailto:This email address is being protected from spambots. You need JavaScript enabled to view it. (Reporting URI of aggregate reports)
  • fo=1 (Dictates what type of authentication/alignment vulnerabilities are reported)

Google Domain Verification Record

This record is used by Google to validate domain ownership when setting up Google Analytics etc

  • google-site-verification=jdyk-vwecyqq7-puxdologp7u629hhanuryqcravu90

Google Domain Verification Record

This record is used by Google to validate domain ownership when setting up Google Analytics etc

  • google-site-verification=n92wr1utg9cbik7zks-rpz5bk6hi5wnd8ijoazqy63s

SPF Record:

The SPF Record defines which IP addresses are permitted to send email on this domain's behalf

  • v=spf1 (The SPF Format Version Number)
  • mx (Permit servers listed in MX records -extra lookup, some server's won't bother)
  • include:_spf.google.com (An Include - Additional look-ups required, some server's won't bother.)
  • include:spf.mandrillapp.com (An Include - Additional look-ups required, some server's won't bother.)
  • include:mta1ip.mindbox.cloud (An Include - Additional look-ups required, some server's won't bother.)
  • include:mta2ip.mindbox.cloud (An Include - Additional look-ups required, some server's won't bother.)
  • ip4:205.201.128.0/20 (The IPv4 Address of a permitted sender - make sure this scopes your outgoing mail server)
  • ip4:198.2.128.0/18 (The IPv4 Address of a permitted sender - make sure this scopes your outgoing mail server)
  • ip4:148.105.8.0/21 (The IPv4 Address of a permitted sender - make sure this scopes your outgoing mail server)
  • ip4:192.243.55.0/24 (The IPv4 Address of a permitted sender - make sure this scopes your outgoing mail server)
  • include:_spf.salesforce.com (An Include - Additional look-ups required, some server's won't bother.)
  • ~all (Permit other hosts but take note)

Processing 5 MX (Mail Exchanger) Records

These Records determine the servers (mail servers) responsible for handling your incomming email. Each service is given a priority and they will be used in that order. If all the priorities are the same then they will be used in a round-robin fashion

  • Priority 1 handled by host aspmx.l.google.com. [64.233.167.27] Valid
    • Email Handled By Google Corporation
    • Port 25 (smtp) : Open
  • Priority 10 handled by host alt3.aspmx.l.google.com. [108.177.125.26] Valid
    • Email Handled By Google Corporation
    • Port 25 (smtp) : Open
  • Priority 10 handled by host alt4.aspmx.l.google.com. [74.125.20.26] Valid
    • Email Handled By Google Corporation
    • Port 25 (smtp) : Open
  • Priority 5 handled by host alt1.aspmx.l.google.com. [108.177.14.26] Valid
    • Email Handled By Google Corporation
    • Port 25 (smtp) : Open
  • Priority 5 handled by host alt2.aspmx.l.google.com. [74.125.200.27] Valid
    • Email Handled By Google Corporation
    • Port 25 (smtp) : Open

Processing 1 CNAME (Alias) Records

These records are aliases making one hostname relate to another. These are often used to match hosts back to clusters or internal referencs that may change.

  • www.semrush.com. www.semrush.com.cdn.cloudflare.net.

Processing 2 A (IPv4 Address) Records

These records define the IP Addresse(s) of the servers responsible for hosting your webiste and other resouces on your domain. The www record is the most common one and will be used to identify your website address

  • Host: semrush.com. = IP: [104.18.69.106] Valid Reachable (13.994ms)
  • Host: semrush.com. = IP: [104.18.70.106] Valid Reachable (14.058ms)

Processing AAAA (IPv6 Address) Records

These records define the IP Addresse(s) of the servers responsible for hosting your webiste and other resouces on your domain

    Processing Domain Public Records

      Domain Name WHOIS Information - semrush.com

      • Domain Name SEMRUSH.COM
      • Registry Domain ID 1522609536_DOMAIN_COM-VRSN
      • Registrar WHOIS Server whois.onlinenic.com
      • Registrar URL: http://www.onlinenic.com
      • Updated Date: 2018-07-09T09:38:41Z
      • Creation Date: 2008-10-03T16:45:33Z
      • Registry Expiry Date: 2019-10-03T16:45:33Z
      • Registrar OnlineNIC, Inc.
      • Registrar IANA ID 82
      • Registrar Abuse Contact Email This email address is being protected from spambots. You need JavaScript enabled to view it.
      • Registrar Abuse Contact Phone +1.5107698492
      • Domain Status: clientTransferProhibited https://icann.org/epp#clientTransferProhibited
      • Name Server NS-1063.AWSDNS-04.ORG
      • Name Server NS-2037.AWSDNS-62.CO.UK
      • Name Server NS-246.AWSDNS-30.COM
      • Name Server NS-850.AWSDNS-42.NET
      • DNSSEC unsigned
      • URL of the ICANN Whois Inaccuracy Complaint Form: https://www.icann.org/wicf/

      Website Hosting WHOIS Information - 104.18.69.106

      • NetRange 104.16.0.0 - 104.31.255.255
      • CIDR 104.16.0.0/12
      • NetHandle NET-104-16-0-0-1
      • Parent NET104 (NET-104-0-0-0-0)
      • NetType Direct Assignment
      • OriginAS AS13335
      • Organization Cloudflare, Inc. (CLOUD14)
      • RegDate 2014-03-28
      • Updated 2017-02-17
      • Ref: https://rdap.arin.net/registry/ip/104.16.0.0
      • OrgName Cloudflare, Inc.
      • OrgId CLOUD14
      • Address 101 Townsend Street
      • City San Francisco
      • StateProv CA
      • PostalCode 94107
      • Country US
      • RegDate 2010-07-09
      • Updated 2018-10-10
      • Ref: https://rdap.arin.net/registry/entity/CLOUD14
      • OrgTechHandle ADMIN2521-ARIN
      • OrgTechName Admin
      • OrgTechPhone +1-650-319-8930
      • OrgTechEmail rir@cloudflare.com
      • OrgTechRef: https://rdap.arin.net/registry/entity/ADMIN2521-ARIN
      • OrgNOCHandle NOC11962-ARIN
      • OrgNOCName NOC
      • OrgNOCPhone +1-650-319-8930
      • OrgNOCEmail noc@cloudflare.com
      • OrgNOCRef: https://rdap.arin.net/registry/entity/NOC11962-ARIN
      • OrgAbuseHandle ABUSE2916-ARIN
      • OrgAbuseName Abuse
      • OrgAbusePhone +1-650-319-8930
      • OrgAbuseEmail abuse@cloudflare.com
      • OrgAbuseRef: https://rdap.arin.net/registry/entity/ABUSE2916-ARIN
      • RNOCHandle NOC11962-ARIN
      • RNOCName NOC
      • RNOCPhone +1-650-319-8930
      • RNOCEmail noc@cloudflare.com
      • RNOCRef: https://rdap.arin.net/registry/entity/NOC11962-ARIN
      • RTechHandle ADMIN2521-ARIN
      • RTechName Admin
      • RTechPhone +1-650-319-8930
      • RTechEmail rir@cloudflare.com
      • RTechRef: https://rdap.arin.net/registry/entity/ADMIN2521-ARIN
      • RAbuseHandle ABUSE2916-ARIN
      • RAbuseName Abuse
      • RAbusePhone +1-650-319-8930
      • RAbuseEmail abuse@cloudflare.com
      • RAbuseRef: https://rdap.arin.net/registry/entity/ABUSE2916-ARIN

    Processing Website

      Website Headers for www.semrush.com

      We will obtain the headers from your website and parse them for validity

      • Web Server is cloudflare
      • Server header does not contain version information
      • Request Response HTTP/1.1 200 OK OK
      • SSL is available and enabled
        • /OU=Domain Control Validated/OU=Hosted by OnlineNic Inc/OU=PositiveSSL Wildcard/CN=*.semrush.com
        • Locality
        • Organisation
        • Certificate Scope *.semrush.com
        Certificate Issuer
        • Country GB
        • Organisation Sectigo Limited
        • Certificate Scope Sectigo RSA Domain Validation Secure Server CA
        Certificate Validity
        • Valid From 190521000000Z
        • Valid To 200520235959Z
        Certificate Ciphers
        • SN RSA-SHA256
        • LN sha256WithRSAEncryption
        Certificate Extensions
        • Alternative Hostnames DNS:*.semrush.com, DNS:semrush.com
        • Key Usage TLS Web Server Authentication, TLS Web Client Authentication
    • There was a redirect to https://www.semrush.com/
    • General

      • allow Valid methods for a specified resource after a 405 : Missing
      • location For Redirects specifies the target : Missing
      • connection Control options for the current connection [keep-alive]
      • x-powered-by Specifies Technology in use - Security Risk : Missing
      • x-aspnet-version Specifies the ASP.net version - Security Risk : Missing
      • accept-ranges To advertise its support of partial requests : Missing
      • link Used to express typed relationship with another resource : Missing
      • upgrade HTTP/2 (The latest and faster version of HTTP is available : Missing

      Security

      • referrer-policy Modifies the algorithm used to populate the Referer Header : Missing
      • x-xss-protection Prevents pages loading when XSS is detected [1; mode=block]
      • feature-policy Allow or Deny the use of browser features : Missing
      • p3p Platform for Privacy Preferences [policyref="/w3c/p3p.xml", CP="CUR ADM OUR NOR STA NID"]
      • content-security-policy CSP Content Security Policy : Missing
      • x-frame-options Can we open this response in an iframe [SAMEORIGIN]

      Cross Origin

      • access-control-allow-origin Can we share the response with the given origin : Missing
      • access-control-allow-credentials Tells Browsers whether to expose the response to frontend JavaScript : Missing
      • access-control-expose-headers Indicates which headers can be exposed as part of the Response : Missing
      • access-control-max-age Indicates how long the results of a preflight request can be stored : Missing
      • access-control-allow-methods Methods allowed when accessing the resource in response to a preflight request : Missing
      • access-control-allow-headers Indicates which headers can be used during the actual request : Missing

      Content

      • content-language The natural language or languages of the intended audience [en]
      • transfer-encoding The form of encoding used : Missing
      • content-length The length of the response body : Missing
      • content-type The Media type of the Response Body [text/html; charset=utf-8]
      • date The date and time of generation [Thu, 20 Jun 2019 08:01:35 GMT]
      • content-disposition An opportunity to raise a File Download dialogue box : Missing
      • content-encoding The type of encoding/compression used on the Response : Missing
      • content-location An alternate location for the returned data : Missing
      • content-range Where in a full body message this partial message belongs : Missing
      • etag An identifier for a specific version of a resource : Missing
      • vary how to match future request headers [Cookie]
      • x-content-type-options Types in Content-Type should NOT be changed [nosniff]

      Cache

      • cache-control Tells caches whether they may cache this object [no-cache]
      • expires Gives the date/time after which the response is considered stale : Missing
      • last-modified The last modified date for the requested object : Missing
      • pragma Implementation-specific fields for caching : Missing
      • x-cache-action From an Intermediate cache : Missing
      • x-cache-hits Intermediate Cache Hits count : Missing
      • x-cache-age Intermediate Cache Content Age : Missing
      • via Informs the client of proxies through which the response was sent : Missing
      • age The Age this page has been cached in a proxy : Missing
      • x-served-by The Cache that served this response : Missing
      • x-cache Indicates if the cache served cached content : Missing
      • x-via-fastly Specific headers from Fastly : Missing

      Strict Transport Security (HSTS) Policy

      • strict-transport-security A HSTS Policy for the client with scope [max-age=31536000; includeSubdomains; preload]

      Cookies and Fragments

      • set-cookie Cookie Data to store locally [__cflb=3437946050; path=/; expires=Fri, 21-Jun-19 07:01:35 GMT; HttpOnly]

      Other

      • x-backend-server Identifies the backend server providing this response : Missing
      • x-robots-tag Search engine Robot Directive : Missing
      • gen Used by some of the GEN Tools to verify zone ownership : Missing
      • cf-cache-status Cloudflare Specific Header indicating cache status for this response : Missing
      • x-aspnetmvc-version ASP MVC Version Number - Security Risk : Missing

      Not Profiled

      • cf-ray [4e9c37339eda35ac-LHR]
      • expect-ct [max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"]
      • x-semrush-meta-title [SEMrush - Online Visibility Management Platform]
      • x-service [index]

    Robots.txt

    • You have a robots.txt file and it appears to be valid
      • Allow Entries (18) - Specific Allow
        • Disallow Entries (48) - Specific Disallow
          • Sitemap Entries (1) - Sitemaps
            • https://www.semrush.com/sitemap.xml
          • Other Entries (11)

        Processing Website Profile Data

          Website Render for www.semrush.com

          Technology Profile semrush.com

          We will check for fingerprints of common website technologies

            • Failed to succesfully profile the website, it is likely either custom or plain HTML.

          MOZ Rank Profile https://www.semrush.com/

          We will retrieve your Ranking Profile from Moz.com

          • 216796 The number of external, equity links
          • 508885 The number of internal and external equity and non-equity links
          • 81 The Domain Authority (DA) ( 0->100 )
          • 68 The Page Authority (PA) ( 0->100 )
          • 6.800000191 The MozRank of the Domain ( 0->10 )

          Google Safe Browsing https://www.semrush.com/

          We will retrieve Safe Browsing Status from Google

          • This site is NOT listed as being unsafe by Google

          PhishTank Lookup https://www.semrush.com/

          We will check PhishTank to see if your site is listed

          • This site is NOT listed as being unsafe by PhishTank

          Alexa Rank Profile https://www.semrush.com/

          We will retrieve your Ranking Profile from Alexa.com

          • 3494 The number of external in links
          • 4949 Your Alexa Rank

          Meta Profile https://www.semrush.com/

          We will check the entire body for metadata

          • theme-color : #ba4717
          • format-detection : telephone=no
          • twitter:creator : @semrush
          • twitter:title :
          • twitter:site : @semrush
          • viewport : width=device-width, initial-scale=1, viewport-fit=cover
          • twitter:description : SEMrush offers solutions for SEO, PPC, content, social media and competitive research. Trusted by over 3,000,000 marketers worldwide
          • twitter:card : summary_large_image
          • description : SEMrush offers solutions for SEO, PPC, content, social media and competitive research. Trusted by over 3,000,000 marketers worldwide

        Processing Completed

        • Performance Profile
          • DNS Lookups : 0.32 seconds
          • DNS Folding/Unfolding : 0.00 seconds
          • DNS Nameserver Checks : 0.00 seconds
          • DNS TXT Records : 0.00 seconds
          • DNS MX Records : 0.97 seconds
          • DNS CNAME : 0.00 seconds
          • DNS Address : 0.05 seconds
          • WHOIS Lookups : 0.48 seconds
          • First CURL : 0.10 seconds
          • Second CURL : 0.38 seconds
          • SSL Lookup : 0.32 seconds
          • Header Parsing : 0.00 seconds
          • Robots.txt Parsing : 0.10 seconds
          • Website Profile : 3.54 seconds
          • Website MozData : 0.20 seconds
          • Safe Browsing : 0.11 seconds
          • PhishTank : 0.16 seconds
          • Website Alexa : 1.00 seconds
          • Website META : 0.32 seconds

        The process is now completed and the results are shown above. The raw processing data is available HERE. Please take a moment to consider each test and its response. DNS, SMTP and HTTP are not simple protocols and it is way beyond the scope of this tool to suggest improvements, but you are welcome to request assistance via our Forum.