SQL, Big Data and Data Warehousing in Cloud

Internals, Performance Research, Cost Optimization

  • About
  • About
  • AWS,  EMR,  Hadoop,  YARN

    Amazon EMR – Downscaling and Ghost (Impaired) Nodes

    August 27, 2019

    I already wrote about recovering the ghost nodes in Amazon EMR clusters, but in this article I am going to extend this information for EMR clusters configured for auto-scaling.

    Read More
    dmtolpeko

Recent Posts

  • Sep 11, 2019 Hadoop YARN – Calculating Per Second Utilization of Cluster using Resource Manager Logs
  • Sep 04, 2019 Tuning Hadoop YARN – Boosting Memory Settings Beyond the Limits to Increase Cluster Capacity and Utilization
  • Aug 27, 2019 Amazon EMR – Downscaling and Ghost (Impaired) Nodes
  • May 23, 2019 Amazon EMR – Recovering Ghost Nodes
  • May 23, 2019 Amazon EMR – Recovering Unhealthy Nodes with EMR Services Down

Archives

  • September 2019 (2)
  • August 2019 (1)
  • May 2019 (9)
  • April 2019 (2)
  • January 2019 (3)
  • December 2018 (4)
  • November 2018 (1)
  • October 2018 (6)
  • September 2018 (2)

Categories

  • Amazon (9)
  • AWS (13)
  • Cost Optimization (1)
  • Data Skew (1)
  • Distributed (1)
  • EMR (9)
  • ETL (1)
  • Hadoop (8)
  • Hive (9)
  • Hue (1)
  • I/O (10)
  • Logs (1)
  • Memory (3)
  • Monitoring (4)
  • ORC (5)
  • Pig (1)
  • Qubole (1)
  • S3 (7)
  • Snowflake (5)
  • Spark (1)
  • Storage (9)
  • Tez (5)
  • YARN (10)

Meta

  • Log in
  • Entries RSS
  • Comments RSS
  • WordPress.org
Savona Theme by Optima Themes